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PREFACE 


SPONSORSHIP OF THE WORK 

This volume was prepared by the Statistical Research Group, Divi- 
sion of War Research, Columbia Universit/, for the Applied Mathematics 
Panel, National Defense Research Committee,. Office of Scientific 
Research and Development. The work was initiated under contract 
OEMsr-618 and complctetl under contract OEMsr-1131, both between 
the Trustees of Columbia University and the Office of Scientific Research 
and Development. Royalties, at usual rates, are being paid by the 
publisher to the United States government; no royalties are being paid to 
Columbia University or to any private institution or individual. The 
publisher has agreed that ten. years after the date on which this volume is 
issued the copyright thereon shall be relinquished and the work shall 
become part of the public domain. 

The Statistical Research Group was organized and its initial staff 
selected by Warren, Weaver, Chief of the Applied Mathematics 
Panel, on- July 1, 1942. The staff was drawn from universities and 
research organizations throughout the country, many of which generously 
granted leaves for the work. The group disbanded September 30, 1945, 
except for a few persons who have prepared this and another volume as 
monographs in connection with the Applied Mathematics Panel’s Sum- 
mary Technical Report. 

NATt?RE OF THE BOOK 

This book discusses a series of problems that occur frequently in 
planning, analyzing, or interpreting quantitative data. Various tech- 
t-o hbiiSe av/dsj.upd, ic tejiro? xJ boJb 

general principles and specific procedures. 

The book is written for scientists, engineers, managers, and statis- 
ticians. It seeks to explain the statistical approach to various problems, 
to expound the theory that can be brought to bear on each problem, to 
point out the features of the problem that determine the relevance of the 
theory, to give detailed and Avorkable computational procedures, includ- 
ing formulas, tables, and charts, and to illustrate the interpretation of 
the results. Concrete illustrative material is used to bring out the 
interplay of substantive and statistical considerations, the illustrations 
being selected primarily for the light they throw on the art of applying 
statistical techniques and only secondarily for intrinsic interest. Although 
relatively little new statistical theory is included, several topics are given 
more thoroughly integrated and carefully e.xpounded treatment than has 
previously been available, an<l many new tobies are included. 
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la preparing this book, the authors have kept in mind the reader who 
is interested in applying statistical techniques in his work but who either 
docs not have much interest in o^ time for studying general statistical 
theory as such, or else feels that he can best understand and appreciate 
statistical theory through a series of special problems. Even the statis- 
tical theorist, hoAvever, should be able to deepen and broaden his under- 
standing and appreciation of statistical theory by examining special 
problems in some detail. 

The chemical, physical, and engineering sciences are, on the whole, 
distinctly backward in the statistical planning of experiments and the 
analysis of empirical data, at least by comparison with the social, biologi- 
cal, and agricultural sciences. No doubt this is partly because physical 
scientists have attained a high degree of proficiency in experimental 
techniques and can make repeated, independent experimental investiga- 
tions of a given phenomenon — they can “think with their hands” — so 
that competent investigators are likely to learn the truth (though periiaps 
belatedly and at excessive cost) despite crmlities in statistical techniques. 
In the social and biological sciences, on the other hand, repetition or 
control of experimental procedures is usually impossible, at least in any- 
thing like the degree achieved in the physical sciences, so that the truth 
can be learned only through highly developed statistical techniques 
closely coupled (as statistical techniques must always bo) with sound 
scientific knowledge and techniques. But even though sound statistical 
techniques may not be indispensable in the physical sciences, they are 
invaluable. Increasing recognition of this, accelerated by developments 
during the war, is leading to the rapid introduction of statistical methods 
into chemistry, physics, and engineering; indeed, it seems likely that in 
the immediate future the greatest contributions of statistics vnll be to, 
and its greatest developments will arise from, the physical sciences. 
(The physical sciences may, however, yield this distinction to medicine, 
which is said to be nearly as dependent on statistics as the social sciences 
and nearly as backward statistically as the physical sciences.) 

BACKGROUND 

During the war the Statistical Research Group carried on three kinds 
of work: (1) It advised and assisted the Army, the Navy, and the Office 
of Scientific Research and Development on the statistical aspects of 
problems arising in. their actirities; this cor^tituted the largest part of 
the work. (2) It assumed primary responsibility for the investigation of 
certain problems of a predominantly statistical or probabilistic character. 
(3) It developed, reviewed, or expounded statistical techniques; this was 
the smallest part of the work and was incidental to the first two. 
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The great bulkiS)f the work fell into tlie first two categories, and the 
final products did not emphasize statistical techniques as such. From 
this work, however, there arose a number of developments in applied 
statistics, as well as some in theoretical statistics. This book has been 
prepared to preser\'c and to disseminate useful statistical material that 
was almost a by-product of the responsible and cooperative handling of 
practical military, scientific, engineering, and production problems. 

AUTHORSHIP 

Because it would be difficult or impossible accurately to assign per- 
sonal credit and responsibility for tkis volume, itsauthorship is attributed 
to the Statistical Reacarcli Group*as a whole. Under ordinary circum- 
stances the basic material of the various chapters would have been 
published in technical journals by the oripnatore individually. Under 
the actual circumstances, many ideas are presented here for the first 
time in chapters prepared by others than those who did the basic work. 
It thus becomes important to ^sign credit for the ideas in such chapters 
without at the same time implying responsibility for the entire content 
or emphasis. An attempt has been made to do this by notes at the 
beginning of the chapters. The editors, and in particular the under- 
signed, however, have exercised final judgment and authority over the 
form and content of each chapter and are thus in the unhappy position 
of having to assume all responsibility for the shortcomings of the book 
without being able to claim credit for its merits. 

The fallowing were mem bere of thcseniorsciefitificsCaff of the Statistical 
Research Group, and the influence of each is reflected in the book. 

Kenneth J. Arnold, University of irwc<msin 
Rodin F. Bennett, Columbia University 
Julian H. Bigelow, Institute for Advanced Study 
Albert H. Bowker, Stanford University 
Churchill Eisenhart, National Bureau of Standards 
(on leave from University of IFiscormn) 

H. A. Freeman, Massachusetts Institute of Technology 

Milton Friedman, University of Chicago 

M. A. Girshick, U. S. Bureau of the Census 

Millard W. Hastay, National Bureau of Economic Research 

Harold Hotelling, University of North Carolina 

Edward Paulson, University of North Carolina 

L. J. Savage, University of Chicago 

Herbert Solomon, Stanford University 

George J. Stigler, Broum University 

A. Wald, Columbia University 

W. Allen Wallis, University of Chicago 

J. Wolfowitz, Columbia Universiiy 
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CHAPTER 1 


USE OF VARIABLES IN ACCEPTANCE INSPECTION 
FOR PERCENT DEFECTIVE 

1. ATTRIBUTES AND VARIABLES 

Acceptance inspection is the process of judging whether a lot of items 
is of acceptable quality by examining a sample from the lot. Such inspec- 
tion is widely and successfully used in industry. It is usually carried out 
by classifying each item in the sample as either defective or nondefective, 
then deciding from the number of defective items in the sample whether 
the percentage of defective items in the lot is small enough for the lot to 
be considered acceptable. Thus, the quality of the lot is measured by the 
percentage of defective items, and this is judged by classifying the sample 
items according to attributes. 

Often the sample items are classified as defective or nondefective 
on the basis of a measurable quality characteristic. For e.xample, the 
items may be classified as too heavy or not, although the actual weight 
could be measured; they may be classified as too short or not, although the 
length could bo measured; they may be classificil as haring an excessive 
volatile content or not, although the volatile content could be measured; 
they may be classified as operating too fast or not, although the speed 
could be measured; they may be classified as having loo short a useful life 
or not, although the useful life could be measured. Such cases, where 
inspection is based on attributes, may be contrasted with cases in which 
inspection is based on variables, that is, on the actual measured values of 
the characteristic. 

Inspection by variables has one major advantage over inspection by 
attributes; fewer items need be inspected for a given degree of accuracy 
in judging a lot^s acceptability; or, conversely, decisions about the lot 
are more reliable if based on a sample inspected by variables than if 
based on a sample of the same size inspected by attributes. The reason 
for this is that variables inspection provides more information about 
the quality of eachdtem; for example, that the volatile content is 16.02 
percent or 20.61 percent, as the case may be, instead of merely that the 
volatile content exceeds, say, 16 percent in both cases. Since variables 
inspection provides more information about each item, a smaller number of 
sample items gives the same amount of information about the lot, or the 
same number of sample items gives more information about the lot. 

r 
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The principal advantage of in.spection by attributes over inspection 
by variables is that it requires less skill, less time, or less expensive equip- 
ment to inspect each item; less record-keeping to record the results of 
inspection; less arithmetic to determine from the sample results whether 
the lot should be judged acceptable. Usually this advantage of simplicity 
more than offsets the fact that more items must be inspected under 
attribute than under variables inspection. 

Another advantage of attribute inspection is that the selection and 
installation of sound sampling plans is easier. In fact, complete and 
detailed procedures are available in such form that Little or no previous 
knowledge of technical statistics is required for their successful use. * In 
attribute inspection the mathematical theory about the manner in which 
quality varies from one item to another is always fulfilled if the sample is 
selected at random from the lot. The mathematical theory underlying 
variables inspection plans, on the other hand, is that quality varies among 
the items of the lot in accordance AviCh a normal (Gaussian) distribution; 
whether this theory is a sufficiently good approximation to the facts in a 
particular inspection problem is a matter requiring investigation by 
statistical methods. 

There are other less important reasons for preferring attributes to 
variables. One of these is a misapprehension as to the amount of arith- 
metic required, often based in large part on ignorance of short-cut 
computational procedures. Another such .reason is e.xaggeration of the 
limitations impo.sed by the normality assumption in the mathematics 
underlying variables inspection. 

Attributes are sometimes used instead of variables because well-known 
sampling plans for variables measure lot quality by the average or the 
variability of the measurements, while well-known attribute plans meas- 
iireit by the percent defective. Percent defective is often theappropriate 
measure, and its appropriateness is not affected by shifting between 
attributes and variables. For example, in inspecting rods for length, the 
percent too short may in some circumstances be a better measure of 
quality than either the mean or the variability of length — as when 
rods below a certain length are useless while those above that length can 
easily be trimmed at virtually no extra cost. Similarly, in determining 
whether 'individual packages in a lot provide full measure, the percent 
below the specified measure may be more significant than the average 
measure. Variables plans for percent defective exist but are not widely 
kno wn. f 

*See, for example, Statistical Jtesesreh Group, Sampling Inspection; Dodge and 
Romig, Sampling Inspection Tables (for full citations see See. IS). 

fSce especially the following two papers, of wKicVx this chapter is primarily a 
development; Jexnbtt and Weiajh, “The Control of Proportion Defective’': Johnsox 
and Welch, “Applications of the Non-central I Distribution.” 
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Although in most cases attribute plans are undoubtedly more economi- 
cal than variables plans lor percent defective, because the lower cost of 
inspecting each item usually more than offsets the increase in the number 
of items that must be 'inspected, variables inspection offers decided 
advantages in far more instances than has usually been recognized. This 
is especially true when the inspection process is costly, as for example 
when it requires c.xpensivc time, equipment, or personnel, or when the 
items are expensive and are damaged or destroyed by inspection. It is 
also true when measurement by variables costs only a little more than 
classification by attributes, or when for purposes other than acceptance 
inspection the data on variables are more valuable than those on attrib- 
utes. Thus it is desirable that the practical aspects of variables plans be 
more fully developed and the plans made more generally available than 
has hoietofore been tiie case. 

2. BACKGROUND OF THE PLAN 

A variables plan of acceptance inspection for percent defective is based 
upon the sample mean and the sample standard.deviatioji. Other meas- 
ures of central tendency and variability could Be used, for example, the 
median and the range, other measures are considered in this chapter, 
howeVer, because other measures all require larger samples to give as good 
results as the mean and standard deviation. The gains in computational 
simplicity that may be afforded by other measures are likely to be unim- 
portant in the situations for which variables inspection is appropriate. 
Although in routine inspection operations it is not necessary to compute 
either the mean or the standard deviation, it will clarify the ideas to begin 
the discussion in terms of them. 

A normal distribution, such as that shown in Fig. 1.1, is characterized 
by two quantities (parameters), its mean u and its standard deviation cr. 
Kormal distributions have large or small means according as /i is large or 
small; the observations are tightly clustered or widely scattered about the 
mean according a& a is small or large. The proportion of the observations 
exceeding a certain upper limit, say (/, depends upon how far the limit is 
above the mean, measured in terms of the standard deviation. For 
example, if the limit exceeds the mean by twice the standard deviation, 
that is, if = M + 2cr, 2.276 percent of the observations exceed the limit; 
but if the limit exceeds the mean by three times the standard deviation, 
that is, if £/ ^ -h 3<r, only 0.135 percent of the observations exceed the 

limit. To determine the percent of observations exceeding any limit, first 
subtract Che mean from the limit and then divide the difference by the 
standard deviation; that is, compute 





( 1 ) 
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ivhich shows the difference between the limit and the mean &s & multiple of 
the standard deviation. Various tables show for different values of K 
.what part of a normal distribiition exceeds K* 



From formula (I) it is clear that the proportion exceeding a given 
iimit C/, which we will call the fraction defective, depends upon both the 
mean and the standard deNdation. For a given standard deviation, the 
fraction defective is smaller the smaller the mean ; but, however small 
the mean, the standard deviation may be large enough to cause a high 

* See, ioT example, Table l.I in this chapter. By far the most extensive table is 
that prepared by Ibe ISew York Mathematical Tables Project, Tobias o) ProbohUity 
Funclxcmi. This gives probabilities to 15 decimal places lor values of K (denoted by 
X in the tables) from 0 to 1 by steps of 0.0001, and for all values of K above 1 by steps 
of O.OOV. 

Some cate is required in using tables of the normal probability function, since 
two different kinds of table are common and several methods of tabulation are used. 
The two kinds of tabic differ in the units used to measure the difference between the 
limit and the mean, the most common type (illustrated by Vol, II oi the NYMTP 
tables) measuring this as a multiple of the standard deviation and the other type 
(illustrated by Vol. I of the NYMTP tables) measuring it as a multiple of times 
the standard deviation. Thus, to enter the second type of table, K computed, from 
formula (1) must be divided by -v/2 = 1.414. In either type of table the entries may 
represent (a) the proportion exceeding K, which is the same as the proportion, below 
— fC; (6) the proportion below K, which is the same as the proportion above —A; 
(c) the proportion between the mean and K, which is the same as the proportion 
between the mean and —K; (d) the proportion between — K and K; (e) the proportion 
below —K and above +A'. Given any one ol these five values, the others are easily 
* computed from the facts that the distribution is symmetrical about the mean and 
that the total proportion is one. 
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fraction defective. For a fixed mean le^ than the limit, the fraction 
defective is smaller the smaller the standard deviation; but, however 
small the standard deviation, the mean may be large enough to cause a 
liigh fraction dcfec|ivc. The acceptability of any mean, when quality 
is measured by fraction defective, depends on the standard deviation; and 
the acceptability of any standard deviation depends on tlie mean. 

Figure 1.2 illustrates various combinations of the mean and standard 
deviation, that correspond to the same lot quality, as measured by fraction 


(T 



Fig. 1.2. — Combinationa of n and a eorreaftonding with the same percent defective. 

defective. Any combination corresponding to a point on the sloping 
line represents the same quality; coxnhinattons to the left of tiie fine 
represent better quality (lower fraction defective), those to the right worse 
quality. Any lot quality can be represented by such a line, the percent 
defective being greater the steeper the line.* Thus a lot is accept- 
able, in the sense that it has a fraction defective less than or equal 
to a specified acceptable quality level (AQL), whenever (W — p)/<T is 
greater than or equal to a certain value of K which depends on the AQr> 
and can be determined from tables of the normal probability function. 
In other words, the lot is acceptable if its mean plus a certain multiple of 
its standard deviation does not exceed the limit; that is, if 

/X + Kff < U (2) 

*l/ob qualities worse than 50 percent defective would be represented by a line 
starting at ^ “ tr, v « 0 and sloping upward to the right. When the mean exceeds 
the limit the percent defective exceeds 60, and for a given mean the percent defective 
is smaller the larger the standard deviation. Such cases are rarely of interest in 
acceptance sampling but can be treated by formulas (lOj (2')i (S') below. 
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The discussion so far has been entirely in terms of the lot mean and 
standard deviation. In practice, the lot mean and standard deviation, 
y. and <7-, are unknown, and it is necessary to judge from the sample mean 
and standard deviation, x and s, whether they satisfy criterion (2). This 
can be done by adding a multiple of the sample standard deviation to the 
sample mean and comparing the sum with the limit. In choosing the 
multiple of the sample standard deviation, however, allowance must be 
made for the fact that the mean and standard deviation determined from 
the sample are subject to fluctuations from sample to sample. That is, if 
a number of samples are drawn from lots having exactly the same fraction 
defective, the samples will not all yield the same value of {U — x)/s. 
Thus the acceptable level of {U — x)/s, say fc, must be small enough so 
that there will not be too high a probability that an acceptable lot will 
fail to meet the acceptance criterion for the sample, namely, 

x~^ks<U (3) 

If tJie sample contains measurements on N items (that is, contains 
N observations) represented by xi, X 2 , • • • xn, the sample mean x is 

* Xi + x* + • • • + x,v -X,’ 

" N ~ N 

the sample variance s* is 

, (xi ~ x)^ + (xi - x)' -H ■ ■ • + ixf, - x)- ^{Xi - x)^ 

^ irn. N - 1 

and the sample standard deviation 3 is the square root of the sample 
variance. 

A few miscellaneous remarks will complete the background of vari- 
ables inspection plans for percent defective: 

The symbols y and <r are used to indicate the population mean and 
standard deviation; x and s are used to represent the sample moan and 
standard deviation. Similarly, K is used to represent the deviation 
of the lot mean from the limit in units of the lot standard deviation, and 
k is used to represent the deviation of the sample mean from the limit in 
units of the sample standard deviation. This is in conformity Avith 
the sound and increasingly prevalent practice of using notation that 
emphasizes the distinction between true lot {population or universe) 
'parameters and sample estimates of these parameters — ^an estimate mean- 
ing in statistical usage a value calculated from a sample (not guessed or 
judged in the»everyday sense of “estimate") according to established 
principles for estimating lot parameters from sample data. Neglect of 
the distinction between lot parameters and sample estimates of them 
can be (and often is) a ca\ise of serious confusion. The quantities x and 
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s, wliich for brevity liave been ealled the sample mean and standard 
deviation, should properly be called the sample estimates of the lot mean 
and standard deviation. 

The use of — 1 instead of N in the denominator of the variance 
(see formula (5)] has no real influence on the sampling plan provided the k 
of expression (3) is chosen ^\^th due regard to whether or — 1 is used. 
If JV is used, the proper value of Jt is greater by a factor y/N/iN — 1) 
than if A^ — 1 is used, so k times a is the same in cither case. If, however, 
the value of s is itself of interest, the use of A^ — 1 is preferable. 

Although formula (5) is useful for bringing out the meaning of the 
standard de\’iation, it should not be used for computing purposes. For 
computing, use one of the following two forms; 


- 


— 


N 


N - 1 


NZx^ - {ZxY 
NiN - 1) 


(6a) 

( 6 &) 


For purposes of acceptance inspection, however, it is not necessary (as 
will be seen later) actually to compute the standard deviation. 

For concreteness It is assumed that defective items are those for which 
the value of the quality characteristic exceeds some upper bound of 
satisfactory quality U. It would be equally appropriate to assume that 
defective items are those below some minimum In that case, equa- 
tions (1), (2), and (3) would be 


if 

(T 

(!') 

ft — Kff ^ .If 

(20 

X — ks > M 

(30 


In what follows, the assumption is retained that defectives are items that 
are too large, but from equations (10» (^Oi and (3') the application to 
cases where defectives are items that are too small will be obvious. 


3. THREE PHASES OF A VARIABLES SAMPLING PLAN 
3.1. The Three Phases 

A sampling procedure may be analyzed into three phases: 

(1) The plan of action, that is, the set of rules on the basis of which 
to accept or reject the lot.* 

(2) The amount of inspection required by the plan, that is, the number 
of items that must be inspected from each lot. 

• Some plans allo'W a third decision, to inspect more items; see Sec. ll.fi. 
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(3) The operating ckaraderistics of the plan, that is, the proportions 
of submitted lots of various qualities that will be accepted and rejected 
if the plan is used. 

3.2. Plan of Action 

The plan of action for variables inspection, for percent defective is as 
follows: 

a. A sample of N items is selected at random from the lot. 

h. The quality characteristic being inspected is measured and recorded 
for each item of the sample. 

c. The mean and standard deviation are computed from the N 
measurements. 

d. The sample standard deviation is multiplied by a certain constant 
k and added to the sample mean. 

e. The lot is*rejccted if the value of x + fcs found in step d exceeds U, 
the limit of the quality characteristic above which an item is considered 
defective; otherwise, the lot is accepted. 

In practice, steps c and d can be replaced by a single step that consists 
essentially of adding the squared values of the N sample measurements; 
in that case step c remains essentially as stated, though the actual 
mimbers used in it are different. 

Thus, the plan of action is characterized by two parameters: the 
sample size N and the multiplier of the standard deviation k. {U is 
associated ^^ith the definition of quality rather than ^vith the sampling 
plan, since it simply defines a defective item.) 

3.3. Amount of Inspection 

Under the plans considered here, which are single-sampling plans, the 
number of items inspected per lot is always the same for a given plan. 

Single-sampling plans for fraction defective based on attributes can 
sometimes be curtailed, that is, terminated without inspecting all N 
items. Curtailing is possible as soon as the number of defectives reaches 
the rejection number or the number of defectives plus the number of 
items remaining to be inspected is less than the rejection number. Plans 
based on variables can also be curtailed, provided there is some minimum 
possible value of the characteristic being inspected. Most acceptance 
inspection involves quantities that can under no circumstances bo less 
than zero, so curtailing before inspecting all N items is technically pos- 
sible. The simplest example of this possibility is the case in which, with 
k positive, the sum of fewer than N measurements exceeds NU, making 
it clear that for the entire N items x will exceed U and x ks will exceed 
it still further. That there are other cases, less e.xtreme but more compli- 
cated to describe, in which curtailing is possible can be seen by studying 
Sec. 11.3 below. Ordinarily, however, curtailing is not considered 



Sec. 3.4 


VAIUABLES 


15 


because computations are not started until all measurements have been 
made. IVhen it is possible to carry out simple computations while the 
data are being collected and it is important to minimize the amount of 
inspection, sequential analysis of the data will be considciably more 
efficient than merely curtailing a single-sampling plan. A brief outline 
of a plan for secjuential analysis of fraction defective by variables is 
presented in Sec. 11.6. 

3.4. Operating Characteristics (OC) 

There are evidently many possible plans of action, for each different 
combination of sample size and multiplier of the standard deviation 



Fi<3. 1.3. — Typical operalmg-charscfcerisfic (OC) curve. 

gives a different plan of action. If a large number of lots containing a 
given fraction defective p are submitted to a given plan, a certain pro- 
portion Lp are accepted; and this proportion differs from one plan to 
* another. For each plan of action, it is important to know what propor- 
tion of submitted lots will be accepted for each possible quality p of 
submitted lots, as a plan is clearly unsuitable if it passes too many of the 
lots of unsatisfactory quality or rejects too many of the lots of acceptable 
quality that are submitted to it. 

This information is shown by the operating-characteristic (OC) curve 
of the plan. The ordinate of the OC curve shows the proportion Lp of 
lots that will be accepted when the fraction defective in submitted lots 
is p. The proportion of submitted lots of quality p that will be rejected 
is 1 — Lp. The OC curve of Fig. 1.3 is typical: it shows a probability of 
1 of accepting a lot having no defectives. As the fraction defective 
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TABLE 1.1 

Nohmal Deviates Exceeded with Given Probability 


Values of liTe for various *, where 






€ 

0.00 

0.0 

0.1 ' 

0.2 

0.3 

0.4 

0 

^ 1 

00 

1.28155 

0.84162 

0.52440 ' 

0 25335 

1 

3.09023 1 

2.32635 

1.22653 

0.80642 ' 

0.49585 1 

0.22754 

2 

2.87816 1 

2.05375 

1.17499 

0.77219 1 

0.46770 1 

0.20189 

3 

2 . 74778 1 

1.88079 

1.12639 

0.73885 1 

0.43991 

0.17637 

4 

2 . 65207 

1.75069 

1.08032 

0.70630 

0.41246 

0.15097 

5 

2 . 57583 ' 

1.04485 

1.03643 

0.67449 1 

0.38532 

0.12566 

6 

2.51214 ' 

1.65477 

0.99446 

0.64335 1 

0.35846 

0.10043 

7 

2.45726 ' 

1.47579 

0.95417 

0.61281 1 

0 33185 

0.07527 

8 

2,40892 

1.40507 

0.91637 

0.58284 1 

0.30548 

0.05015 

9 

2.36562 1 

1.34076 

0.87790 

0.55338 ' 

0.27932 

0,02507 


When < > 0.5, K* *• — When < » 0.5, Ko.» » 0. 

The entries in column («) arc additional digits for the values of e shown m the top 
row. Thus, the entry 1.12639 in column (0.1) and row (3) corresponds with e » 0.13; 
similarly, the entry 2.74778 in column (0 00) and row (3) corresponds with « » 0.003. 

A final 5 in italic indicates that, in rounding, the nearest odd digit should be used 
in the fourth decimal place. When a final 5 is not in italic, follow the usual rule of 
rounding 0,5 to the nearest even integer. Thus a final pair 55 becomes 6, 35 become-s 
3, 85 becomes 9. 


For a detailed table see The KelUy Statistical Tables; Table I gives values of K, 
(denoted by x) to 8 decimal places for values of < (denoted by q) from 0 to 0.6 by 
steps of 0.0001, Alternatively, see Fisher and Yates, Statistical Tables; Table I gives 
values of /T, (denoted by x) to 6 decimal places for values of e (denoted by P/2) from 
0 to 0.495 by steps of 0.005; also Table IX gives values of A% + 5 to 4 decimal places 
for values of 1 — « from 0 to 0.980 by steps of O.OOl and from 0.9800 to 0 9999 by 
steps of 0.0001, 


4.3. Illustration 

To illustrate the use of equations (10), (H), and (12), suppose that 
lots are considered acceptable if the percent defective is 15 or less and 
unacceptable if the percent defective is 30 or more, and suppose the 
maximum producer's and consumer’s risks are to be 1 percent and 2 per- 


cent, respectively. Then 

pi = 0.15 a = 0.01 (13) 

P2 = 0.30 /? = 0.02 (14) 

From Table 1.1, using only 4 decimal plac^, we find^ 

A^ = 1.0364 K„ = 2.3263 (15) 

Ks = 0.5244 Kff = 2.0537 (16) 
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Substituting from (15) (16) into (10) giv^ . 

_ 2.3263 X 0.5244 + 2.0537 X 1.0364 
2.32G3 -b 2.0537 

_ 3.3484 
“ 4.3800 


= 0.7645 


Substituting from (15) and (16) into (11) gives 

2 X 4.3800* + 3.3484* 
2 X 0.5120* 

= 94.6 


(17) 


(18) 


The same value of N results from substituting from (15), (16), and (17) 
into (12) 

0.7645* + 2 /4.3800V 

2 Vo.5120/ ^ ^ 


N = 


» 1.2922 X 73.1829 
* 94.C. 


Thus, in this case a sample of 95 items would be drawn at rnndom 
from tho lot and a measucetaeut of the characteristic being inspected 
would be made on each item of the sample. The sum of the measure- 
ments and the sum of their squares would be computed. These sums 
would be substituted into equations (4) and (6) to find the sample mean 
and standard deviation, x and s. Finally, x -f- 0.7G45s would be com- 
puted; if it exceeded U (the value of the quality characteristic above 
which an item is considered defective) the lot would bo rejected, other- 
wse the lot would be accepted. (Actually, the abbreviated computa- 
tional procedures described in Sec. 7 might be used.) 

4.4. Adjustment of N 

If the sample size given by (11) and (12) is too large, two new points 
may be selected in such a way that the OC curve will be less steep. For 
example, if pi and pi are kept at 15 and 30 percent but a and are 
doubled, to 2 and 4 percent, N is reduced to 72; or if a and are kept at 
I and 2 percent but pi and pt are changed to 10 and 35 percent, N becomes 
32. 

4.6. Adjustment of fc with N Fixed 

4.6.1. Formula. — If for some reason N is definitely fixed, the OC curve 
can be made to pass through any one point desired, say 

p - Pi Zip, = 1 - a (20) 

by setting 

1 _ Ki + ^/K\ — ab 


a 


( 21 ) 
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where the plus sign is to bo use«l if or > 0.5 and the minus sign if a < 0.5, 
and where r 


and 

•r 


a = 1 — 


2(iV - 1) 




( 22 ) 

(23) 


4.6.2. Example. — Suppose, for example, that a sample of 95 has been 
decided upon, and a sampling plan is desired such that the OC curve 
passes^through the point defined by (14). Then (20) becomes 


Hence 


Pi = 0.30 Lp, = 0.02 

(24) 

1 we find 


Kx = 0.5244 A'. = -2.0537 

(25) 

, 4.2177 

^ * 188 

(26) 

= 0.9776 


5 = 0.2750 - ifZ 

(27) 

= 0.2306 


ah = 0.2254 

(28) 

- ah = 0.2750 - 0.2254 

(29) 

= 0.0496 


\/Af - a6 = 0.2227 

(30) 

0.5244 + 0.2227 

0.9776 

0 }} 


= 0.7C42 


This differs slightly from the value 0.7645 yielded by (17) for a sample 
of 95 and an OC curve passing through the points defined by (13) and 
(14). The value of k yielded by (31) would'bc equal (except for differ- 
ences due to rounding) to that yielded by (17) if in (22) and (23) both N 
and — 1 were taken as 94.6. 

4.6.3. A Special Case : Indifference Quality. — If is fixed and k is to 
be selected so that the OC curve will pass through one specified point, 
this point might reasonably be chosen at the indifference quality- po- 
The indifference quality is the quality at which it is a matter of complete 
indifference whether the lot is accepted or rejected.* Lots of better 

* For a discussion of the indifference quality as a key to the selection of sampling- 
inspection plans, .see Statistical Research Group, Sampling Inspection, Chap. 15, Sec. 
2.2.1. 3. p. 145. 
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quality should be accepted more often than rejected, lots of worse quality 
should be rejected more often than accepted, and lots of the indifference 
quality should be accepted and rejected equally frequently. Thus, a in 
(20) becomes 0.5, becomes 0, and (21-) reduces tolc — Ko, the normal 
dedate e.Yceeded with probability equal to the indifference quality. 

If k is determined from the indifference quality, it does not depend 
upon N, for the term in (22) and the term in (23) that involve N drop 
out when Ka = 0. Thus if fc is determined from the indifference quality, 
changes in N will not change the value of p for which acceptance and 
rejection are equally likely, nor will they require changes in k. Roughly 
speakin^changes in N affect the steepness of the curve, while changes in 
k affect^s location with respect to the quality scale. 

4.6. Approximations in the Plan 

Three kinds of approximation, are involved in using formulas (10), 
(11), and (12). First, there is the approximation involved in assuming 
the (juality characteristic to be normally distributed. Second, certain 
mathematical approximations are involved in the derivation of tho 
formulas (see Sec. 11.2). Third, the value of N given by formulas (11) 
and (12) is not ordinarily an integer, so an approximation is involved in 
substituting an integer. The effect of the first approximation is dis- 
cussed later (Sec. 9.4), Even if the quality characteristic were exactly 
normally distributed, the result of the second and third approximations 
would be that the tnie OC curve would not pass precisely through the 
points intended; but it would come sufficiently close for all practical 
purposes. In the present illustration, for example, taking * 95 arfd 
k = 0.7645 results in a producer’s risk of 1 percent at a percent defective 
of 15.04 instead of 15. The inaccuracies duo to the second and third 
approximations tend to be larger for smaller samples, both because tho 
effect of the mathematical approximations is larger and because,, the 
effect of rounding N is, on the average, larger; this point is discussed 
further in Secs. 4.7 and 11.2. 

4.7. Table of N and k 

Tabic 1.2 contains values of N and k for 151 combinations of pi and pj. 
The values of pi in the table range from 0.001 to 0.05; the* values of p 2 
vary from about isPi or %pi up to lOpi or more. The values of a are 
in all cases 0.05 and the values of /3 are 0.10. The values of N and k have 
been computed by methods explained in Sec. 11.5 that do not involve 
the mathematical approximations used in formulas (10) and (11) or (12), 
so they may be slightly different from, and more accurate than, the 
values given by (10) and (11) or (12). This is especially true whqn N 
IS small, not only because of the mathematical approximations under- 
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TABIjE l,2,—~{Conlinued) 


Intended 

pi 

Intended 

Pi 

N 

k 

True 

pi 

True 

Pi 

0.005 

0.0075 

J713 

2.4952 

0.0050 



0.01 

547 

2.4357 




0.012 

328 

2.3907 




0.015 

197 

2.3482 




0.02 

lU 





0.025 

80 

2.2297 




0,03 

61 

2.1886 




0.035 

50 

2.1546 




0.04 

42 

2.1272 


0.0395 


0.05 

32 

2.0723 




0.06 

20 

2.0265 




0.07 

22 

1.9874 



0.0075 

0.01 

2907 

2.3728 

0.0075 

0.0100 


0.012 

1039 

• 2.3339 

HSiim 



0.015 

451 

2.2851 




0.02 

m 

2.2m 




0.025 

130 

2.1700 

Hwnn^i 



^ 0.03 

93 

2.1274 




r 0.035 

72 





0.04 

58 





0.03 

42 

1.9996 


0.0500 


0.03 

33 

1.9501 


^ 0.0601 


0.07 

27 



0.0700 


0.08 

23 

1.8714 


0.0800 

0.01 

0.015 

1231 

2.2385 


0.0150 


0.02 

389 

2.1733 




0.025 

208 



0 .0251 


0.03 

337 

2.0761 




0.035 

101 

2.0372 




0.01 

79 

2.0041 




0.015 

64 

1.9776 




0.05 

54 

1.9527 

0.0099 

0 0499 


0.06 

41 

1.9007 


0.0602 


0.07 

33 

1.8561 


0.0704 


0.08 

28 

1.8271 

0.0099 

0.0787 


0.09 

24 

1.7974 

0.0098 



0.10 

21 

1.7643 

0.0099 

0.0979 
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TABLE 1.2 

Values of N ajs'd k for Variodb Combinations of pi and pr when « = 0.05 and 

p « D.IO 

N is the sample size; k is the multiple of the standard deviation in the criterion 
X + ks < U [or accepting the lot, where U is the value above which the characteristic 
being inspected is regarded as drfective; pi is the acceptable quality level (AQL); 
Ps ia the lot tolerance percent defective (LTPD ) ; a — 0.05 is the producer’s risk ; and 
ft = 0.10 is the consumer's risk. ITie true pi and true pj are the values at which, for 
the corresponding jV and A, « = 0.05 and ^ = O.lO; the diiTerence between tho true 
and intended values of pi and pj arises from the fact that AT must be an integer. 

This table has been computed with the aid of Table IV in Johnson and Welch, 
“Applications of the Non-eentral /-Distribution.” The entries for N, k, true pi. and 
true pj ate therefore slightly more accurate than those given by formulas (lOj, (11) 
or (12), and (42), respectively. Sec See. 11.5 on tho construction of this table, 


Intended 

Pi 

IHill 


k 

True 

Pi 

True 

Ps 


I O.OOL5 

3177 1 

3.0214 

0.0010 

0.0015 


0.002 

1032 

2.97H j 

0.0010 ' 

0.0020 


0.0025 

567 

2.9311 1 

0.0010 

0 0025 


1 0 003 

381 

2.8970 

0.0010 

0.0030 


0 004 

226 

2.8441 

o.oom 

0.0040 


0.005 

101 

2.8018 

0 0010 

0 0050 


0 005 

125 

2.76C0 

0.0010 

0,0001 


0.007 

103 

2.7359 

0.0010 

0.0071 


0.008 ' 

87 ' 

2.7153 

0,0010 

0.0080 


0 OOO 

76 

2 6832 

0 0010 

0,0092 


0.01 

08 1 

2.0725 , 

0.0010 

0.0099 


0.012 ' 

56 

2.6220 

0.0010 

o.om 


0.015 

45 

2.5730 

0.0010 

0,0153 


0.02 

34 

2 5208 1 

0 0010 1 

0.0201 


0.025 

28 

2.47)2 i 

0.0010 

0 0250 

. 

0,03 

24 

2.4392 ' 

0 0010 

0.0294 


1 0 035 

21 

2.3930 1 

0 0010 

0.0351 


0,04 

19 

2.3745 1 

0.0010 

0.0389 


1 0 05 

16 

2.3059 

0,0010 

0.0494 


1 0.00 

14 

2.2570 ' 

00010 

0.0590 


O.OOi 

1677 

2.7109 

0.0025 

0.0040 


0,005 

736 

2.67T2 

0.0025 

0.0050 


0 006 

443 

2.6413 1 

0 0025 

0 0060 


0.0075 

268 

2.5067 

0 0025 

0.0075 


O.Ol 

158 

2. 5376 

0-0025 

O.OlOl 


0 012 

118 

2.4979 ! 

0 0025 

0 0121 


0.015 

86 

2 4570 

0.UD25 

0.0149 


0,02 

59 

2.3875 1 

0.0025 

0.0202 


0.025 

46 

2.3410 j 

0.0025 

0.0249 


0 03 


2.2981 ' 

0 002.5 

1 0.0301 


6.035 

32 

2.2610 

0.0025 

1 0.0348 


0.04 

28 

2.2354 

0.0025 

0.0391 


' 0 05 

1 22 

2.1721 1 

0.0025 

1 0.0501 


' o.oe 

' 19 

2. 1321 1 

0.0025 

1 0.0585 
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0.4029. Thus, even for this case where N is only 0, it is questionable 
whether the greater accuracy of Table 1.2 or of the adjusted k, as com- 
pared with formulas (10) and (11) or (12), ia of substantial value for most 
practical purposes; and for larger values of N the differences are even less 
important. 


6. AMOUNT OF INSPECTION 

5.1. Comparison with Attribute Inspection 

If each item were clasafied simply defective or nondefectivc and the 
acceptability of the lot judged by the number of defectives in a single 
sample, a sample of 145 would be requiretl for an OC cur\’e passing 
through the points defined by (13) and (14).* If the sampling were done 
sequentially by attributes, the average number of items inspected would 
be 20 for lots with no defectives, 63 for lots 15 percent defective, 133 for 
lots 22 percent defective, 61 for lots 30 percent defective, and 7 for lots 
100 percent defective.! • 


TABLE 1.3 

Sample Sizes fok Eight Pairs of Sikglb-sampung Plans Based on Attributes 

AND Variables 


a » 0 05, ^ 0.10 for all plans 

Na * sample size for attributes 
Nt = sample size for variables 


Plan 

number 

pi 

pi 

N, 

.V. 

N.AV, 

Saving 

(No - NO/Na 
percent 

1 


0.002 

1,032 

12,470 

12.09 

91.7 

2 


• 0.06 

14 

46 

3 29 

69.0 

3 

0.01 

0.015 

1.231 

4,185 

3.40 

70 6 

4 

0.01 

0.10 

21 

44 

2.10 

52.3 

5 

0,05 


C61 

1,199 

1.81 

44.9 

6 

0.03 

0.40 

6 

10 

1.67 

40.0 

7 

0.15 


323 

493 

1.53 

34.5 

8 

0.15 


17 

20 

1.53 

34.6 


F<ii attributes the sample sizes have been computed as explained in Chap. 7. For variables they 
have been computed by the metliod denriibed in Scv. 11.5 of tliis chapter, which sometimes Elves values 
alightly different from, and slightly more accurate than, those given by formulus (11) and ( 12 ). 


* See Cliup. 7, Sec. 3, equation (21) and first footnote on p, 2fi0. 
t See Statistical Research Group, Sequential Analysis, Sec 2 (second revision), 
where the example defined by equations (13) and (14) above ia treated in some detail. 
Sequential analysis also can be used with variables (see Sec. 11. ti below) and will 
result in a reduction in the average amount of inspection similar to that with attributes 
— roughly 40 to GO percent (see Sequential Analysis, Appendix A, p. A. 03). 
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The savings in the number of items inspected by using variables 
instead of attributes depends partly upon the steepness of the OC curve 
and partly upon its location. The steeper the OC curve, the greater the 
saving from using v'ariablcs. The better the lot qualities involved (that 
is, the smaller the percentages defective), the greater the sa\dng. Eight 
comparisons of attribute and variables plans arc shown in Table 1.3. In 
each case, a = 0.05 and = 0.10. and Ni represent the sample sizes 
for single-sampling plans based on attributes and variables, respectively. 

6.2. Comparison with Variables Inspection When the Standard Devia- 
tion Is Known 

If the true standard deviation of the characteristic being inspected 
is given, the proportion defective depends only upon the mean, being pi 
or less if the mean is U — K\q or less, and p 2 or more if the mean is 
U — Kacr or more.* If the standard deviation were known, a sample of 
73 would be required for an OC curve passing through the points defined 
by (13) and (14). The reduction of 22 observations (23 percent) from 
the 95 needed when the standard deviation is not known thus represents 

TABLE 1.4 

Saliple Sizes for Eight Pairs op SiNGCE-SAMruNG Vahiasles Plans Based on 
^ Known and Unknown Standard Deviations 
a = 0.05, /S = 0.10 for all plans 
Nt * sample size with standard deviation unknown 
Nn “> sample size with standard deviation known 


Plan ' 
number 

pi 

pi ' 

.V, 1 



Saving 

(Ni - Nn)/N, 
percerX 

1 

0.001 

0.002 

1,032 

190 

5.43 

81.6 

2 

1 0.001 

0.06 


4 

3.60 

71.4 

3 

0.01 

0.015 

1 1,231 

351 

3.51 

71.5 

4 

' 0.01 

0 W 

21 

8 

2,62 

61.9 

5 

0.05 

0.07 

661 


2.20 

54.6 

6 

O.Oo 

0.40 

6 

Bn 

, 1.50 

33.3 

> 

0. 15 

0.20 

323 



.30.0 


0.1.5 

0.40 

17 

■9 

■H 

17.6 


For the knowa standard deviation, the sample si ees ire given by 1/a, where a ia defined by equation 
(137), Sec. 11. 1 of this chapter. For the unknown standard deviation they have beeti computed by the 
method described in Sec, I t.So/ (his chapter, wbicbeometimes gives values slightly diflerent from, and 
slightly more accurate than, those given by formulas (11) and (12). 

the savings in inspection jdeldcd by knowledge of the standard deviation, f 
This saving, like that yielded by sufficient knowledge of the form of 

• The use of variables in inspection for proportion defective when the standard 
deviation is known is discussed by Ilomig, AUotpable Average in Sampling Irispection. 

t Incidentally, 22 is the number of observations required for an OC curve satisfy- 
ing (13) and (H) if (ho fme mean is known and only the standard deviation need bo 
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0.4029. Thus, even for this case where N is only 6, it is questionable 
whether the greater accuracy of Table 1.2 or of the adjusted k, as com- 
pared with formulas (10) and (1 1) or (12), is of substantial value for most 
practical purposes; and for larger values of N the differences are even less 
important. 


6. AMOUNT OF INSPECTION 

6.1> Comparison with Attribute Inspection 

If each item were classified simply defective or nondefective and the 
acceptability of the lot judged by the number of defectives in a single 
sample, a sample of 145 would be required for an OC curve passing 
through the points defined by (13) and (14).* If the sampling were done 
sequentially by attributes, the average number of items inspected would 
be 20 for lots with no defectives, 63 for lots 15 percent defective, 133 for 
lots 22 percent defective, G1 for lots 30 percent defective, and 7 for lots 
100 percent defective.! • 


TABLE 1.3 

Samplb Sizes foh Eight Pairs op SiNOLB-SAMPUKa Plans Based on Attributes 

AND Vahiables 


a ■ 0.05, ^ • 0.10 for all plans 

Na ~ sample size lor attributes 
iVt * sample size for variables 


Plan 

number 

Pi 

P* 

AT, 


AT./Ah 

Saving 

(A^. - Nt)/Na 
fitTcenl 

1 

0.001 


1,032 

12,470 

12,09 

!)1.7 

2 

0.001 


14 

40 

3 29 

09,6 

3 

0.01 

0.015 

i 1.231 

4,185 

3.40 

70.6 

4 

0.01 

0.10 

21 

44 

2.10 

52.3 

5 

0.05 

0.07 

CGI 

1,199 ' 

1.81 

44.9 

6 

0.05 

■SB 

1 6 

10 

1.67 

40.0 

7 

0.15 


323 

493 

1.53 

34.5 

8 

0.15 

■ii 

17 

26 

1,53 

34.6 


For attribut«8 tbe sample sizes have been computed os explained in Chap. 7. For variables they 
have been computed by the method described in Sec. 11.5 of this chapter, which aometimes gives values 
slightly diBerent from, and slightly more accurate than, thoee given by formulas ( 11 ) and (12). 


* See Chap. 7, Sec. 3, equation (21) and first footnote on p, 260, 
t See Statistical Research Group, Sequential Analysis, Sec 2 (second revision), 
where the example defined by equations (13) and (14) above is treated in some detail. 
Sequential analysis also can be usetl with variables (see Sec. 11.6 below) and will 
result in a reduction in the average araoiiiit of luspectioii similar to that with attributes 
— roughly 40 to 60 percent (see Sequential Analysis, Appendix A, p. A.03). 
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The savings in the number of items inspected by using variables 
instead of attributes depends partly upon the steepness of the OC curve 
and partly upon its location. The steeper the OC curve, the greater the 
sav’ing from using variables. The better the lot qualities involved (that 
is, the smaller the percentages defective), the greater the saving. Eiglit 
comparisons of attribute and variables plans are shovm in Tabic 1.3. In 
each case, a = 0.05 and ^ = 0.10. JV* and Ni represent the sample sizes 
for single-sampling plans based on attributes and variables, respectively. 

6.2. Comparison with Variables Inspection When the Standard Devia- 
tion Is Known 

If the true standard deviation of the characteristic being inspected 
is given, the proportion defective depends only upon the mean, being pi 
or less if the mean is C/ — Kia or less, and pj or more if the mean is 
U — K»o or more.* If the standar<l deviation were known, a sample of 
73 would be r€<iuired for an OC curve passing through the points defined 
by (13) and (14). The reduction of 22 observations (23 percent) from 
the 95 needed when the standard deviation is not known thus represents 

TABLE 1.4 

Sa^plz: Sizes for Eiokt Pairs of Sinole-sampliko Variables Based on 

^ Known and Unknown Standard Deviations 
a « 0.05, ^ « 0.10 for all plans 

iV» — eaiiiple si’zo with standard deviation unknown 
iVm Bumple size with standard deviation known 


Plan 
number ' 

Pi 

PJ 

iV| 



Saving 

(.V. - iV„)AV. 
percent 

1 

1 0.001 

0.002 

1,032 



1 81.6 

2 

0.001 

0 06 

14 

4 


71.4 

3 

0.01 

0,015 

1,231 

351 

3.51 

71.5 

4 

0.01 

1 0 10 

21 

1 ^ 

2.62 

61,9 

5 

1 0.05 

0.07 

661 


2.20 

54.6 

6 

0.05 

0 40 

1 6 

’ 4 

1.50 

33.3 

Y 

0.15 


323 

1 226 

1 43 


0.15 


17 

14 

1.21 

17.6 


For the known etand&rd deviation, the sample eiies are given hy 1/a, where o is defined by equation 
(137), Sec. 11.1 of this chapter. For the unknown standard deviation they have been computed by the 
method described in Sec. I ) .5 oi this chapter, which aometimea gives values slightly dlRsrent from, and 
slightly moie accurate than, those given by formulas (11) and (12). 

the savings in inspection yielded by knowledge of the standard deviation, t 
This saving, like that yielded by sufficient knowledge of the form of 
• The use of variables in inspection for proportion defective when the standard 
deviation is known is disciis-sed by Romig, Allowable Average in Sampling Inspection. 

t Incidentally, 22 is the number of observations required for an OC curve satisfy- 
ing (13) and (14) if the true mean is known and only the standard deviation need be 
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distribution to permit the use of variable instead of attributes, varies 
with the OC curve. Comparisons between JVi, the sample size for the 
variables plans with unknown mean and standard deviation, and iV„, the 
sample size with known standard deviation, are shown in Table 1.4 for 
eight plans defined by the same pairs of OC points used in Table 1.3. In 
general, the percentage saving, computed before Nt and are rounded 
to integers, is 10Qk^/{k^ + 2), but for small samples it may'differ from 
this on account of rounding. 

6. OPERATING-CHARACTEHISTIC CURVE 

6.1. Introduction 

The values of k and N may be obtained from (10) and (11) or (12) 
so that the OC curve will pass through two specified points. They may 
be obtained by selecting N arbitrarily and computing k from (21) so 
that the OC curve will pass through one specified point. They may both 
be determined arbitrarily. Regardless of how they are chosen, their 
effects must be evaluated in terms of the OC curve to which they give 
rise. How will they operate with lots of every quality that might con- 
ceivably be offered? If a lot is good, what is the risk that the sample 
from it will fail to meet the acceptance requirement? l^a lot is bad, 
what is the risk that the sample ^vill satisfy the acceptance criterion? 
The OC curve shows, for every possible lot quality p, the probability Lp 
that a lot of that quality will, if submitted, be accepted on the basis of the 
sampling plan. 

6.2, Five-point OC Curve 

Three points bn the OC curve are easily obtained: (1) When there 
are no defectives in the lot, acceptance is certain; (2) when the lot con- 
tains only defectives, rejection is certain; (3) when the proportion of 
defectives in the lot is po, such that Kp, = A;, acceptance and rejection arc 
equally likely. Thus three points on the OC curve are given by 


p = 0 

IjO ~~ 1 

(32) 

p = Po 

Lp, = 0.5 

(33) 

p = 1 

Li = 0 

(34) 


used in testing percent defective. In general, if Ni is the number of oh.‘«ervations 
required when neither the mean nor the standard deviation is known, Nm the number 
required when the standard deviation is known, and N, the number required when, 
the mean is known, the relation ATi = A^., + AT, will hnJd; in fact, A'w, = 2A^i/(k^ + 2) 
and N, =* k*Ni/{k* 2). See Chap. 8 for methods of determining the sample size 
N, when inspection is based on the standard deviation; the sample size Nm, when 
inspection is based on the mean, can be determined from equation (14R) in Sec. 11.1 
of this chapter; it is 1 /a, where a is defined by equation (137). 
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where po is the probability that a normal deviate will exceed k. If'fc and 
N have been detennined by (10) and (11) or (12), the OC curve will also 
pass through the two points 


P = Pi 
P = Pi 


Lp, = I — a 


(35) 

(36) 


A sketch of the OC cun’^e made from these five points is sufficient for 
many purposes. For the illustrative example of Sec, 4.3, for example, 
we have 


p = 0 

Lf) — 1 

(37) 

Pi = 0.15 

i'o.is “ 0.99 

(38) 

Po = 0.2223 

Lo.itst = 0.5 

(39) 

pi = 0.30 

/vo so ~ (^02 

(40) 

p = 1 

II 

o 

(41) 



12 


50 


52 


34 


36 p 


4 16 18 20 22 24 26 28 

Percentag* of defective ilems in submitted lots 

Fio. 1.4. — Operating-characteristic (OC) curve for a variables inspection plan for percent 
defective; ,V = flS. k = 0.7646. \D(dafrom Table 1.6, columns (&), (7), (5).] 
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The central three of these five points are represented by dots in Fig. 1.4; 
the t\vo extreme points are not shown because of the incompleteness of the 
j) scale. * 

6.3. Detailed OC Curve 

As many points on the OC curv'e as desired may be found from the 
following formula, which expresses the normal deviate corresponding with 
the lot quality in terms of the normal deviate corresponding with any 
given probability of acceptance: 

Kj. = h - Kf.^ + 2(iV - 1) 

Formula (42) yields the normal deviate corresponding with p. The value 
of p can be found from Table 1.5, winch shows the probabilities of 
exceeding various normal deviates. 

If p is to bo computed for a number of values of Ly in order to plot 
the entire OC curve, it is convenient while computing (42) to compute 


= ^ + (43) 

If it is desired to find the probability of acceptance for a lotof given 
quality, (42) and (43) can be rewritten as 

(44) 

(45) 

6.3.1. Illustrative Computation for One Point. — To illustrate the use 
of formulas (42) and (43), consider on acceptance-inspection plan defined 
by iV = 95 and 0.7G45. For what lot quality is the probability of 
rejection 1 percent? 

We have 



Then 


W = 95 fc = 0.7045 = -2.32035 


Vw 2{N - 1) 


(46) 

(47) 

(48) 


Substituting into (42), 


Ky = 1.03615 


(49) 
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TABLE 1.5 

Probabilities Corresponding with Given Normal Deviates 



The entries in row (.K,) are additional digits for the values of Kt shown in the first 
column. Thus, the entry 0.0934 in column (2) and row (1.3) corresponds with 
K, = 1.32; similarly, the entry 0.4840 in column (4) and row (0.0) corresponds with 
Kt = 0.04. 


A 5 in italic indicates that, in rounding, the nearest odd digit should be used in 
the preceding decimal place. IMien a 5 is not in italic, follow the usual rule of 
rounding to the nearest even digit. Thus a final pair 55 becomes 6, 3<? becomes 3, 
85 becomes 9. 


For a detailed table see New York Mathematical Tables Project Tables of Proh- 
ability Functions. Tabic I gives values of 1 — 2« to 15 decimal places for values of 
Kt (denoted by x) from 0 to 1 by steps of 0.0001, and for all values of K, above 1 by 
steps of 0.001. 
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Interpolating linearly in Table 1.5, \ve find p = 15.01 percent.* Simi- 
larly, on substituting into (43) we find Kj/ = 0.49285; sop = 31.11 per- 
cent for Lp = 0.01. 

6.3.2. Work Sheet for Detailed OC Curve. — When a number of points 
on the OC curve are needed, it is convenient to arrange the computations 
in a systematic way, as for example that shomi in Table l.fi, which 
contains the computations for the OC curve of the example of Sec. 4.3. 

TAIILE 1.6 

Work Sheet for OpERATiNo-ciiAnACTERisTic Curve 


Basic quantities: N = 95; k = 0.7645; S = yj— + = 0.11677 


(1) 

Lp 

1 (2) 

A'ip 

. (3) 

-S X (2) 

! (4) 

k - (3) 

(5) 

+ (3) 

(6) 

P 

(7) 

F 

(8) 

1 - (1) = V 

0.005 

2 57583 

0.30078 

0.46372 

1.06528 

0.321 

0 143 

0.995 

0,01 

2 32635 

0.27165 

0.40285 

1.03615 

0.311 

0.150 

0.90 

0.02 

2.05375 

0.23982 

0.52408 1 

1.00432 1 

0.300 

1 0.158 

0.f)8 

0.03 

1.88079 

0.21962 

0.54488 

0.98412 ' 

0.293 

j 0.163 

0.97 

0.04 

1 . 75069 

0.20443 

0.56007 , 

0.96803 ] 

0.288 

1 0.166 

1 0.90 

0.05 

1 . 64485 

0 . 19207 

0.57243 1 

0.00657 1 

0.234 

0.169 

, 0.95 

0.15 1 

1,03643 1 

0, 12102 1 

0.64048 , 

0.88552 

0.260 

1 0.188 

0.85 

0.25 ' 

0.67449 1 

0.07878 1 

0.68574 ' 

0.84326 1 

0 246 

1 0.200 

0.75 

0.50 

0 

0 > 

0.76450 

0.76450 ' 

0.222 

0,222 

0.60 


First, enter at the top of the sheet the three basic quantities N, k, and 
*S, S being defined by the left-hand side of equation (47). 

Second, enter in column (I) various ordinates Lp less than or equal to 
0.5 for which the corresponding abscissas p are to be computed. 

Third, enter in column (2) values Kh, of the normal deviates corre- 
sponding with the values of Lp', these may be. obtained from Table 1.1. 

Fourth, enter in column (3) the products of S by the normal deviates 
in column (2)^ 

Fifth, subtract from k the entries in column (3) and enter the differ- 
ences in column (4) . 

Sixth, add to k the entries in column (3) and enter the sums in column 
(5). 

Seventh, enter in column (6) the probabilities corresponding with the 
normal deviates in column (4); these may be obtained fixjin Table 1.5. 

Eighth, enter in column (7) the probabilitit^ corresponding with the 
normal deviates in column (5); these may be obtained from Table 1.5. 


• The value 15.04 percent stated in Sec. 4.6 was obtained by an exact method, 
described in Sec. 11 5, which does not involve the mathematical approximations 
involved in formulas (42) and (43). 
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Ninth, subtract from 1 the values of Lp shown in the first column anti 
enter the differences in column (8). 

Tenth, plot one-half the OC curve, using as abscissas the values of p 
shown in column (6) and as ordinates the corresponding values of Lp 
shown in column (1). 

Eleventh, plot the other half of the OC curve, using as abscissas the 
values of p' sho^vh in column (7) and as onlinates the corresponding 
values of Lp' shown in column (8). 

The OC curve corresponding with Table 1.6 is shown in Fig. 1.4. 
The three dots represent the central three points of Sec. 6.2, formulas (38) 
to (40). 

7. TECHNIQUES OF APPLYING THE PLAN 
7.1. Introduction 

Without calculating either the mean ± or the standard deviation s, 
the computing can be arranged to show whether the acceptance criterion 

f + < t; (50) 

has been mot. This is done partly by rearranging formula (60), and partly 
by carrying out in advance certain steps in the computations that do not 
depend upon the data. 

There is some question as to how much the computational simplifica- 
tions add to the procedure. They are likely to be welcomed by those 
who consider the standard deviation “too complicated for practical pur- 
poses,” and who would therefore resect (50) os an acceptance criterion if 
it were not emphasized that the standard deviation need not actually be 
computed. Those holding this view, however, often have had little or no 
practical experience in computing or using standard deviations, and ivhat 
experience they have had may have been with inefficient computing tech- 
niques. In fact, statisticians do not generally realize how often standard 
deviations are computed by the naive use of formula (5). The mean is 
calculated, then the N differences between it and the obscr\"ations are 
found and recorded; these arc then squared and added, the sum divided 
by N — 1, and the square root taken. Not only is this process tedious 
and liable to error, but there is au inherent loss of accuracy from round- 
ing the differences. The standard deviation should, of course, be com- 
puted from formula (6). With modern computing machines it can be 
calculated simultaneously with the calculation of the mean and mth very 
little extra trouble. AVith the Monroe Model AA-1, for example, the first 
observation is set in the keyboard and the X and = keys pressed in rapid 
succession; then the next observation is set on the keyboard and the same 
two keys pressed again; and so on. When this has been completed for all 
N observations, which takes little more time and trouble than adding the 
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data, the quantities and needed for formula (6) are found in the 
upper and Jon’er dials, respectively. * 

Another reason computational simplifications are perhaps less impor- 
tant than they may at first appear is that the actual values of the mean 
and standard deviation, although not needed for acceptance purposes, are 
valuable for other purposes, as, for example, process control. In fact, 
the conditions under which inspection is based on variables instead of 
attributes are likely to be those where the cost of obtaining each obser- 
vation is so high, because of destruction of test items, use of costly test 
equipment, and so forth, that the cost of analyzing the data is almost 
negligible in comparison. 


7.2. Computational Procedure f 

7.2.1. Formulas. — For any given plan of action, determined by a fixed 
N and k, the left-hand side of formula (50) flepcnds only upon the sinn 
of the observations Sx and the s»im of the squares of the observations 
Let 

A' = Zx ■ (51) 

Y = (52) 


These two sums may be computed easily and simultaneously on any 
automatic computing machine. If only an adding'maehine is available, 
Y can be obtained with the aid of a table of squares, for example, Barlow's. 

Tf k is positive, it may be noted first that if 

A' > NU (53) 

the lot may bo rejected without regard to V. In that case x exceeds U; 
since s must be positive, x + ks uill still further exceed U. ' 

Second, it may be noted that if 

^ UHN - 1) 

- + 1 

the lot may bo accepted without reganl to X. Equation (72) below is, 
liowever, more efficient than (54) in permitting immediate acceptance. 

• This paragraph indicates only the general nature of the procedures for computing 
the standard deviation. Further simplifications are usually possible. Also, the use 
of the Monroe ISIodcl AA-1 as an illustration does not imply that this make or model 
ig superior to other automatic calculating machines. Both the Frid6n and Marchant 
companies make excellent machines. The Statistical Research Group attempted to 
evaluate various makes and models on the basis of about 660 machine-months of 
experience in its offices from 1942 to 1945. The evidence failed to show any one 
make or model to be best, although there were interesting differences. The terms 
"upper dials” and ‘‘lower dials" used in this chapter apply to Marchant and Monroe 
calculators but should be interchanged for Frid€n calculators. 

t For a discussion of the accuracy with which the measurements sjiould be made, 
see Chap. 4. 


(54) 
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Third, if neither inequality (53) nor (54) is satisfied, the lot is accepted 


if 

where 


y < aX‘ -bX + c 


_ + AT - 1 

2C/(Ar - 1) 
Nk^ 

_ 17“(Ar - 1) 


(55) 

(50) 

(57) 

(58) 


If inequality (55) is not fulfillc<l, the lot is rejected. The values of 
a, b, and c given by (56), (57), and (58) do not depend upon the outcome 
of the inspection but only upon the sarnpUng plan defined by N and k 
and upon the definition of a defective item as given by U. When a 
sample has been inspected, the values of X and Y are obtained from the 
observations and sub3tifcutc<l into (55). Formula (78) belou' provides an 
additional condition, linear In X, that may be in.serted between, (54) and 
(55), which are, respectively, independent of and quadratic in X; formula 
(78), however, requires a preliminary estimate of tho region in which the 
sample mean is likely to lie. 

7.2.2. Example. — Consider a sampling plan in which — 96 and 
k = 0.7045. Suppose that for the characteristic being inspected values 
in excess of C/ = 35 are regarded as defective. 

From these values of N, k, and U we have, from (50), (57), and (58), 

a = 0.0283471 (59) 

h = 118.508 (60) 

c = 197.019 (61,) 

Now suppose that a sample shows 

X = = 2,872 

Y = i-a:" = 89,175 

First, it is noted that, since 

X < 3,325 (64) 

inequality (53) is not fulfilled, so immediate rejection is not called for. 
Second, it is noted that, since 

r > 72,675. (65) 

immediate acceptance is not possible on the basis of (54). Applying (55), 
it is found that 

Y < 90,482 

Therefore, the lot is acceptable. 


(62) 

(63) 


( 66 ) 
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In this example 

X = 30.232 
s = 5.000 
X ks = 34-05 

and, since this is less than 35, acceptance is indicated. 

7.3. Graphical Procedure 

7.3.1. Original Data. — The computing involved In substituting X and 
X® into formula (55) may be avoided by the use of a chart. Values of X 
may be plotted horizontally and values of V vertically, and a curve 
(parabola) d^a^vn. showing for each value of X the minimum value of 
I'jB, requiring rejection as determined from formula (55) using the equalit}' 
sign. Then as soon as X and Y are determined from a sample, a point 
may be plotted on the chart. If the point falls on or below the parabola, 
the lot is accepted; if the point falls above the parabola, the lot is rejected. 

Figure 1.5 shows such a curve for the example of Sec. 7.2.2, and the 
point corresponding with the sample of that example is , shown.* Also 
shown in the figure is a lower boundary for the acceptance region. This 
lower boundary arises from the fact that, for any given sum of the obser- 
vations -V, it is algebraically impossible for the sum of the squares of the 
observations V to be less than a certain minimum; this minimum is the 
value y takes when all the observations are equal, namely, 

5'* = § (70) 

If a sample point should fall on the lower line, it would indicate that the 
standard deviation was zero. A sample point cannot fall below the 
lower line unless there is an error in the calculations. 

For practical purposes only a part of the range of X shosvn in Fig. 1.5 
would be needed, for example, that enclosed in the rectangle. Confining 
the chart to this region, as in Fig. 1.6, permits the use of a larger scale 
and thus improves the accuracy of plotting. 

7.3.2. Adjusted Data. — The graphical procedure of Sec. 7.3.1 is 
impractical when the observations are large. In such cases the range of 
variation in F a.s X varies is large relative to the width of the acceptance 
band for a fixed X ; when the Y scale is contracted sufficiently to go on a 
sheet of reasonable size, the upper and lower boundaries of the acceptance 
region are pulled so close together that the chart becomes useless. A 
remedy for this is to replace the sum of the squares of the observations 

• Formula (54) gives the minimum value of formula (55). Actually, it gives a 
value slightly below the minimum, because the minimum, which occurs when 
X « UN{X - D/iNk* + N - l),\sNU*{N ~ \)/{Nk* + 2V - 1). If Fisassmall 
as (54), it is impossible for X to be too large; this is illustrated in Fig. 1.5. 


(67) 

( 68 ) 
( 09 ) 
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by the sum of the squares of adjusted observations Y' where 

Y'='Z{x^Ay (71) 

= Y - 2AX + NA^ 

and A is an adjustment constant. The adjustment constant is, in effect, 
subtracted from each observation before squaring; actually the sum of 
squares of the adjusted obser\’ations, Y\ is obtaintnl directly from -Y and 
Y by formula (71) without adjusting each observation. 

In order to make the chart most useful, the adjustment constant A 
should, if possible, be chosen near the mean of the characteristic being 
inspected. Usually there uill be some evidence as to the general neigh- 
borhood in which the medn lies. If there is no evidence at all, it will often 
be suitable to choose A somewhere in the interval between U/(k^ + 1) 
and U. 

To compute K', X and Y are obtained simultaneously as described 
ill Sec. 7.1, and X is recorded. Then A’^ is copied to the keyboard and 
multiplied negatively by 2A, which may be computed in advance. Next 
NA^, which also should be computed in advance, is added. These two 
operations adjust the sum of squares, and Y' may be copied. from the 
lower dials. An alternative computing procedure, which may be useful 
if the same inspection plan, or at least the same adjustment constant, is 
to be used repeatedly, is to prepare a table shoiving (ar — A)® for the 
various values of x that might be observed. From this tabic can be 
found by simple addition. 

The values of X and Y' determine whether the acceptance criterion 
has been met. If X > NU, immediate rejection may be made, accord- 
ing to formula (63). Instead of (64) for immediate acceptance, we have 

If this is fulfilled the lot may be accepted immediately. Notice that }" 
may satisfy (72) even when Y fails to satisfy (54). Otherwise, a chart 
sunilar to Fig. 1.6 may be dra\vn in which the upper boundary of the 
acceptance region is given by 

y,; = aX^ ~ ih + 2A)X A (r A- NA “) (73) 

'vhere a, b, and c are defined by (66), (57), and (68), and the lower bound- 
8-ry is given by 

I"; = ^- 2AX + iV^" (74) 

Figure 1.7 shows such- a chart for the example of Sec. 7.2.2, the. 
adjustment constant being taken as A = 30. Thus, the equations of the 
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Y»Zx* 



Nots: Tlie curve sliuuld extend ■ndcliuitelj't eeparattii8 l-lie error and rejection regions, but 
in a small figure this would iimke it difficult to identify the termination point of the acceptance 
region. 

FiU. 1.5. — Graphical procediue for determitiiiLg from Hz and Sz* whether x + ka < U; 

=■ 95. * = 0.7645, U ~ 35. 
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Y-E»* 



Note: See note to Fig. 1..^. 

Fiq. 1.6. — Bnlarged segment of computational chart in terms of original data (enlargement 

of area indicated in Fig 1.S). 
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upper and lower boundaries of the acceptance region are 

= 0.0283471X2 - 178.508X + 282.519 (75) 

Y' = 0.0105263X2 - 60X + 85.500 (76) 

Since 2A = 60 and = 85,500, the value of Y' in the sample is, by 
formula (71), 2,355. This does not satbfy in^uality (72), which would 
require that Y' be 1,483 or less; but when the point X = 2,872, Y' — 2,355 
is plotted in Fig. 1.7, it is seen to be within the acceptance region. 

It' is stated in Sec. 7.2.1 that (72) is more effective than (54) in 
permitting immediate acceptance. In the present example, (72) requires 
that Y' < 1,483, which (since X = 2,872) is equivalent to requiring that 
Y < 88,303, whereas (54) requires that Y < 72,675. Thus values of Y 
between 72,675 and 88,303 will lead to immediate acceptance by (72) 
but not by (54). From the point of view of permitting acceptance on 
the basis of Y', rather than the point of view of making the chart usable, 
very nearly the most efficient form of (72) is obtained by setting 

(77) 

where m' is the best estimate of £ available before the sample is inspected. 
In the present example, if ft' is taken as 30, formula (77) shows A about 
21.5. Taking A « 21, formula (72) becomes Y' < 11,028, and since 
the sample value of Y' is 10,446, immediate acceptance is possible. The 
value of A given, by (77) may be made the basis of a condition for accept- 
ance in terms of F; intermediate between (54) and (55), which arc, 
respectively, constant and quadratic in X, the linear condition for accept- 
ance may be inserted 

r < c' - h'X (78) 

where 

6' = 6 - 2aN,t' (79) 

c' = c - aJVV* ( 80 ) 

and a, b, and c are defined by (56), (57), and (58). Taking // = 30 in 
the illustrative example, (78) becomes Y < 90,468, which leads to accept- 
ance. If the value of ft' happens to coincide with x, (78) becomes 
equivalent to (55). 

8. REDUCED AND TIGHTENED INSPECTION 
8*1. Purpose of Reducing or Tightening Inspection 

It is emphasized in ^ecs. 3.4 and 6.1 that the OC curve shows tho 
conditional probability that if a submitted lot has a given quality j) 
It will be accepted. It does not show the probability that a lot of 
quality p will be accepted. This latter probability cannot be controlled 
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by the sampling plan alone, for it depends upon the probability that a lot 
of quality p will be submitted. 

In judging the value of the protection afforded by a sampling plan, 
information about the quality of submitted material is important. The 
fact that a plan rejects 90 percent of submitted lots having a certain 
unacceptable quality may be of little importance if a great many of the 
submitted lots are of that quality; in that case many of the lots passed 
by the plan wall be unacceptable, even though most of the submitted lots 
are rejected. The fact that the plan rejects 90 percent of submitted 
lots of an unacceptable quality p is also unimportant if submitted lots 
rarely have that quality, for then very little such material will be accepted, 
even though most submitted lots are passed. In the first case, when bad 
material is submitted very often, the protection given by the sampling 
plan may be inadequate and require tightening; but in the second case, 
when bad material ia rarely submitted, the protection may bo superfluous 
and reduction may be permissible.* 

8.2. Criteria for Reducing or Tightening Inspection 

8.2.1. Process Average Percent Defective. — The principal criterion 
for determining whether reduced inspection is permissible or tightened 
inspection necessary is the process average percent defective, usually 
called simply the process average or PA, which is an estimate of the 
percent defective computed from a number of lots. 

This estimate is best stated as a confidence interval, that is, an interval 
within which it may be asserte<l with, say, 95 percent confidence that the 
true process average lies. If the estimate were stated as a single figure, it 
would invariably differ from the true process average because of sampling 
fluctuations; and the question would therefore arise as to Avhether the 
difference between the estimated process average and the acceptable 
quality level could reasonably be ascribed to sampling fluctuations, or 
whether on the other hand it indicated a real discrepancy between the true 
process average and the acceptable quality level. A confidence interval 
answers such questions. It is constructed from the sample data in such a 
way that 95 percent, or any other desired proportion 7 , of the samples will 
lead to confidence intervals that overlap the true process average. 

For the purpose of computing the process average, all data in the 
samples from a number h of consecutive lots are thrown together into one 
large sample. The raean.x and the standard deviation s of this combined 
sample are computed from formulas (4) and ( 6 ). Alternatively, they 

* For a general discussion of the principles and methods of tightening and reducing 
inspection, see Statistical Hcsoarch (iroup. Sampling Inspection. The duscussion 
there relates to inspection by attributes, but, insofar as it runs in terms of the OC 
curve and the amount of inspection, it is also applicable to variables. 
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may be computed from the means the standard deviations Si, and the 
sample sizes Ni of the individual samples by the following formulas: 

NiXi + N^t + ■ ■ ■ + NhXh ^NiXi 

iV, + Ar*+ - - ■ ~‘^!r ^ 

(AT, - \),l + (AT, _ i)sl + . . . + (JV^ _ i)si 

, + - xy + N2{x2 -£)*+••• -\-Nk{x, - xy 

" A^r+jvs -H • • • +jvr- 1 

(82) 

- 1)5? + 2'iVi.f? - 

where 

N = SiV, (83) 

From i, s, and U wo compute ko, the observed difference between U 
and the sample mean in units of the sample standard deviation 


K 



(84) 


Then, given a confidence coefficient y, a confidence interval which in a 
fraction y of samples will overlap the true fraction defective may be 
obtained from formulas (42) and (43) by substituting for k and (1 — y) /2 
for Lp. The p and p' given by (42) and (43) are the upper and lower con- 
fidence limits Py and p,, respectively, for the fraction defective produced 
by the process. The larger the confidence coefficient, the broader the 
interval; and the smaller the confidence coefficient, the narrower the 
interval. In fact, if 7 is I, the interval runs from 0 to 100 percent; 
and if y is 0 , the interval includes only the point p — p, where p h the 
probability that a normal deviate will exceed k^. 

If the acceptable quality level lies above the confidence interval, 
reduced inspection is permis.sible. * If it lies below the confidence interval, 
tightened inspection is necessary. If it lies within the confidence 
interval, normal inspection may be continued. 

In order to avoid too frequent shifts in the degree of inspection, it is 
advisable that the criteria for resuming normal inspection when tightened 
or reduced inspection is in effect should differ from the criteria for remain- 
ing on normal inspection when it is already in effect. One w’ay to achieve 
this is to use a larger confidence coefficient when deciding whether to 
continue normal inspection than when deciding whether to resume nor- 

* For reduced inspection, it is customary to impose a further requirement to 
restrict the variability of the process averaRC from lot to lot. This usually takes the 
form of requiring that each of the last twenty (or some other number) lots have been 
acceptable, 
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inal inspection. Reduced inspection, for example, will be installed as 
soon as the, process average falls to a certain level, but once it has been 
installed normal inspection will not be resumed unless this level is exceeded 
by a certain margin. It is ther^ore possible, once either reduced or 
tightened inspection has been installed, to continue it under conditions 
that would not justify its introduction were normal inspection in effect. 

8.2.2. Illustrative Computation of Process Average. — Suppose that 
the combined sample from several inspection lots contains 95 observa- 
tions, that their sum is 2,872, that the sum of their squares is 89,175, 
and that values above 35 represent defects. Suppose a confidence coeffi- 
cient 7 c of 0.99 is used for judging whether to continue normal inspection 
and a confidence coefficient 7 ^ of 0.95 for judging whether to resume nor- 
mal inspection. Thvis 


= 95 = 2,872 

2x2 = 89,175 

(85) 

U = 35 7. - 0.99 

7r = 0.95 

(80) 

Then, from formulas (4) and (6) 

X = 30.3316 « 

* 5.000 

(87) 

so 

, 35 - 30.2310 

fc.- 

= 0.9537 

(88) 


Entering Table 1.5 svitli K, = 0.9537, we find (by linear interpolation) 
17.01 percent as the point estimate p, corresponding with a confidence 
coefficient of zero, of the process average percent defective. 

To find the 99 percent confidence limits, we substitute k = 0.9537, 
Lp = (1 — 0.99)/2 = 0.005 into (42) and (43). The details of a similar 
computation are shown in Sec. 6.3.1. The 99 percent confidence limits 
are 

po .09 = 10.15 percent an<l = 26.29 percent (89) 

Similarly, taking Lj,= 0.026, the 95 percent confidence limits are 
. po.96 = 11.57 percent and ^o.es = 23.86 percent (90) 

If normal inspection is in effect, it will be continued if the AQL for the 
product is between 10.15 and 20.29 percent defective; reduced inspection 
will be installed if the AQL exceeds 26.29 percent and tightened inspection 
will be installed if the AQL is below 10.15 percent. If tightened or 
reduced inspection is in effect, normal inspection will be resumed if 
the AQL is between 11.57 and 23.86 percent. If the difference between 
the intervals for continuation and for resumption is too small, that is, if 
too many shifts occur, it can be widened by increasing the difference 
between the two confidence coefficients used. 
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For routine operations in which the same AQL and the same value of 
U are to be used repeatedly, it is.dearable to prepare a table showing for 
various sample sizes the values of k^, that result in continuing normal 
inspection if it is in use and those that result in resuming normal inspec- 
tion if tightened or reduced inspection is in use. In the present illustra- 
tion, for example, if the AQL is 15 percent, a value of computed from 
95 observations leads’ under normal inspection to continuing normal 

^ _ A 

inspection if it lies between ^o. 9 & = 0.7380 and ^ 0.99 = 1.4107, or leads 
under reduced or tightened inspection to resuming normal inspection if it 
lies between fco .95 = 0.8048 and fco. 9 s = 1.3113. These values are deter- 
mined from formula ( 21 ), using both the plus and the minus signs to obtain 
upper and lower limits and taking pi = AQL, or = (1 — 7 ) 72 . An exam- 
ple of the computation of (21) is given in See. 4.5.2. 

8.3. Methods of Reducing or Tightening Inspection 

Reduced inspection may be achieved by reducing N, perhaps as 
much as 40 or 50 percent, and adjusting k so that the producer’s risk 
will not be increased. This leaves the OC curve approximately unchanged 
for qualities equal to or better than the AQL but Increases the risk that 
lots of worse quality will, if submitted, be accepted. 

Tightened inspection may be achieved by increasing k but leaving N 
fixed. This moves the OC curve to ^e left, thus reducing the consumer’s 
risk but increasing the producer’s risk. 

9. CHOICE OF QUALITY STANDARDS AND EVALUATION OF PROPOSED 

SAMPLING PLANS 

9.1. General Discussion 

The definition of a defective item, the choice of an AQL and an 
LTPD,* and the selection of producer’s and consumer’s risks usually 
require a compromise betw’een what is technically or economically desir- 
able in the use for which the product is intended and what is technically or 
economically feasible in its production. Although no fixed rules can be 
established for selecting U, pi, pz, a, and a few guides arc worth noting. 

• LTPD, or lot tolerance percent defective, is defined aometimes in terms of the 
use for which the product is intended, as the worst quality for which there should he 
any appreciable probability of a lot’s being accepted, and sometimes, in terms of the 
sampling plan, as that quality for which the probability of acceptance has a specified 
value (customarily 10 percent). Similarly, the AQL, or acceptable quality level, is 
defined sometimes as the worst quality that can be consistently accepted or as the 
beat quality for which there should be any appreciable probability of a lot’s being 
rejected, and sometimes, as that quality for which a certain sampling plan gives a 
specified probability of rejection (customarily 5 percent). Wo follow the definitions 
in terms of sampling plans, using the customary risks of 6 and 10 percent for the 
AQL and LTPD, respectively. 
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Some of these five quantities can be selecUxl arbitrarily or by conven- 
tion Avithout restricting the range of available plans. For example, 
it is more or less conventional to take the producer’s risk a as 5 percent 
and the consumer’s risk ^ as 10 perc^t. Then the AQL, or pi, be 
defined as that quality for which the probability of acceptance should be 
95 percent and the LTPD, or pi, as that quality for which the probability 
of acceptance should be 10 percent. Sometimes a and 0 are set tenta- 
tively and values of U, pi, and pi selected; then the values of a and 0 may 
be reexamined in the light of the number of lots of qualities pi and pz 
likely to be submitted and the costs of rejecting those of quality pi or 
accepting those of quality pi. 

To select a sampling plan, rivo independent analyses shoiild be made 
and their results merged. One study should consider the uses to which 
the product is to be put. What is reqtiired of each item, how rigid are 
these requirements, and what is the effect of a certain percentage of the 
items failing to meet the requirements? The other study should consider 
the production process. Within what limits do most of the items fall, 
how stable are these limits, what would be the costs of improving them, 
and what is the cost of having a lot rejected? In designing a sampling 
plan on the basis of these two studies, it is necessary to take into account 
the cost of inspection. What is the cost of drawing a sample, what is 
the cost of inspecting the items, what is the cost of analyzing the data, 
and how do all these vary with the size of the sample? 

9.2. Analysis of Production Possibilities 

It should be assumed that the producer will consider the OC cur \’0 as 
in effect the specification of what will be accepted, and that he will adjust 
his operations to an OC curve as best suits his own circumstances. For 
example, if the producer finds that a rejected lot entails considerable 
costs, he will consider that the given OC curve actually forces him to 
produce at a quality much better than the AQL, how much bettor depend- 
ing upon how sharply the cost of production rises and the probability of a 
rejection declines as quality improves. If improvements in quality are 
also costly, a given OC curve may mean that the consumer will receive — 
and, of course, ultimately pay for — better quality than he needs. Under 
such circAimstances the consumer will find it advantageous to increase the 
amount of inspection, for which also he ultimately pays; this will steepen 
the OC curve, that is, increase the rate at which the probability of a 
rejection declines as quality improves, and therefore reduce the degree to 
w'hich the producer is forced to improve the quality and raise the cost.* 

There is obviously a relation bctw'een U on the one hand and pi 

* Some discussion of this point is given in J, Przyborowski and H. Wil6nski, 
“Testing Clover Seed,” especially Sec. 111(b), pp. 281-285. 



SbO. 9.3 


VAIlIAItLES 


47 


and p 2 on the other. If 1/ is set very high, only very bad items are 
considered defective; only a small percentage of such items can be 
accepted, so pi should be small. If U is set very low, items are considered 
defective when they deviate very little from normal; the effect of such 
items is less serious, so a lai^er percentage of them can be accepted. 

If we regard U as fixed, we may, by analyzing data on the quality 
characteristic that is to be inspected, estimate what proportion defective 
is being produced. Section 8.2 gives a method for finding confidence 
inten’als to j)y which, in a proportion y of the samples from which 
such confidence intervals are computed, overlap the true fraction defec- 
tive; or, if the confidence coefficient is reduced to zero, we may obtain a 
single-valued estimate p. The height of the 00 curve over the interval 
Py to f)y then indicates approximately how much of the current production 
u’ould be passed by a proposed sampling plan. 

If, on the other hand, we regard pj as fixed, we may estimate the 
value of V necessary to give a confidence y that the fraction defective will 
not exceed pi. This value is 

i + kyS (91) 

where ky is given by formula (21), using the plus sign and taking pi as 
the fixed fraction defective and « as 1 — r. Thus, in the example of 
Sec. 8.2.2, where pi = 0.15, x = 30.232, and s = 5.000, h.u = 1.2G32 
and ifco .99 = 1. 3095; so we may be 95 pendent confident that under the 
conditions prevailing Avhcu the sample was collectcKl at least 85 percent 
of the items lie below t/o.ti = 36.54, or 09 percent confident that at least 
85 percent lie belou' L/i.n * 37.08. U is called a “tolerance limit.”* 

9.3. Analysis ofi Consumption Requirements 

In analyzing the consumption, or design, requirements of a product, 
account should be taken of the variability of other products or methods 
with which it will be associated in use. A discussion of this is beyond the 
scope of this chapter, t but one especially simple example may bo men- 
tioned. 

• See Chap. 2 for a discussion of tolerance limits. Chapter 2, however, is con- 
cerned with two-sided tolerance limits, that is, values of k such that at least a given 
proportion P of the popuiatioii is jncluderJ between the limits x — ks and z -+■ ks. 

An excellent discussion of tolerance limits, which in fact is the original source 
from wh ich subsequent theoretical work has developed, U given in Shewhart, Statistical 
Method, Chap. 11, pp. 50-79, JIow Establish IJmlts of Variabilitj’^? 

t See Shewhart, Economic Canlr<A of Quality, Part V, pp. 247-272, Statistical 
Basis for Specification for Standard Quality, especially Chap. XVII, pp. 249-261, 
Design Limits on Variability, in which See. 5, pp. 252-256, considers Tolerances for 
Quality of Finished Product in Terms of Tolerances of Piece-parts, and Sec. 6, pp. 
256-259, discusses The General Problem of Setting Tolerances on Controlled Product. 
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Suppose the items from a lot arc to be assembled at random in sets of 
n, and a set of n will be defective if the sum of the lengths of the n pieces 
exceeds nJJ\ that is, if the mean length in the set exceeds V . If we 
consider lot quality measured by the percent of means of n that exceed U' 
and select two points on the desired OC curve, values of N and k, say N' 
and fc', can be obtained from (10) and (11) or (12). If now inspection is 
carried out on the basis of individual items, rather than sets of n, the 
lot can be accepted if in a sample of nN' items 

x-\-^s<U' (92) 

Vn 

where x and s are the mean and standard deviation computed from the.nA^' 
items. 

If in this example a piece were considered defective if it exceeded one- 
nth the allowable sum for n pieces, that is, if it exceeded 17', the sampling 
plan would require a sample of N' items and the acceptance requirement 
would be 

x + k's < U' (93) 

This would necessitate production at a higher quality than would (92). 
For example, if n = 4 and k ** 0.7645, the indifference quality, that is, 
the quality having an equal chance of acceptance or rejection, is 35,12 
percent defective for (92) and 22.23 percent for (93). If n = 9 and 
k » 2.0077 (the k given in Table 1.2 forpi = 0.015, ps = 0.03), the indif- 
ference quality is 25.17 percent under (92) and 2,23 percent under (93). 

As a digression, it may be observed that averages in sets of n may be 
appropriate measures of quality when inspection is undertaken to deter- 
mine whether full measure is delivered. Suppose tomato juice is packed 
in one-gallon cans* that the final purchasers buy one at a time. Then 
any purchaser whose can contains less than one gallon is cheated, whether 
or not some other purchaser receives an equivalent or even a greater 
excess. Even though the purchaser would not be cheated in the long run 
if hi.s purchase were repeated frequently, an appreciable shortage in any 
one can may inconvenience or annoy him — in fact, may prevent his 
repeating the purchase. In such circumstances, the appropriate meas- 
ure of lot quality is the percent of cans coatamiiig less than a stated 
amount, say one gallon, or perhaps 0.99 gallon if a 1 percent deviation is 
permissible. If, however, the tomato juice is to be sold to restaurants in 
cases of 12 cans, the appropriate measure of lot quality is the percent of 
groups of 12 that average less than one gallon per can. If the tomato 
juice is to be sold to Army camps in carloads, the percent of carloads 

The example is taken from Peach, Induatruil Statistics, p. 86. Peach, however, 
treats the example differently. 
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averaging less than one gallon per cun is the appropriate measure of lot 
quality; in such a case, however, one carload might well be an inspection 
lot, that the lot mean would become the appropriate qualitj’’ measure. 


9.4. Normality Assumption 

If within lots the distribution of items is not approximately normal, the 
sampling plan usually controls the percent defective as consistently as if 
the distribution were normal, but not at the level intended. 

What the plan actually controls is the quantity defined by equation 
(1), namely, 


K = 



(94) 


Thus a lot is rejected if the sample value of K, say ko, is too small and 
accepted if it is sufficiently lai^e. The OC curve might be plotted with 
the horizontal axis representing the true value of K in submitted lots; 
such an OC curve would be essentially correct regardless of the normality 
of the distribution within lots. The assumption of normality becomes 
important when translating values of K into values of p, the fraction 
defective. 

If the distribution is not normal but its form is stable from lot to lot 
and is such that the percent defective is determined by K, then it is possi- 
ble to substitute for Table 1.5 another table more appropriate for translat- 
ing K into percent defective. In any event, it may be asstimed that the 
fraction defective corresponding with any K does not exceed (1//^)®; and 
if the distribution is unimodal and has its mode near its mean it may bcj 
assumed that for any K the fraction defective docs not exceed (2/3it)*.* 

The effects of non-normality arc excellently stated by Jennett and 
Welchrf 

The above theory is developed on the assumption that the parent population 
sampled is Gaussian. Even if it is not, the reasoning relating the distribution of 
fcg with K will not be invalidated unless the samples are very small, because non- 
normality will not have much influence on x and «, The chief error lies in con- 
necting K with p by using the normal tables. This can Le obviated if some other 
constant distributional form can be assumed for which the relation between the 
standardized deviate K and p is known. If we could say that the distribution 
would maintain the same shape . . . , although with possible changes in the 
mean and standard deviation, the above theory would need little modification. 

* These quantities are based on the Tchebycheff and Camp-Meidell inequalities, 
respectively (see Shewhabt, Economic Control of Quality, pp. 176-177) ; in the present 
context they can be halved if symmetry can be assumed, and reduced further if 
positive skewness Ls assumed. 

t “The Control of Proportion Defective.” The passage quoted is from Sec. 3, 
p. 88, Effect of Non-normality. The notation in the passage as quoted has been 
altered to agree with that iwed in this chapter. 
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It would be misleading, however, to lay too much emphasis on the necessity 
for making the connection between K and p correctly. Usually it is not possible 
to say with absolute certainty that a particular value of p is satisfactory and 
another, differing little from it, is unsatisfactory. Indeed, often it may not be 
clear that p has any intrinsic impoilance at all, but it may still be useful for 
purposes of control. For the same reason K may be regarded as a useful feature 
of the distribution to aim at controlling, without inquiring too closely into the 
exact meaning of K. Non-normsdity is therefore not such a serious matter as it 
may appear. However, no final word can be said about this without reference 
to the context in which the method is to be used. 

10. SIMULTANEOUS USE OF SEVERAL SAMPLING PLANS 
10.1. Inspection of Several Quality Characteristics 

Often the quality of an item depends upon several variables. There 
may be measurements of physical dimensions, for example, those which 
determine whether the item will fit properly in a final assembly, or 
whether full measure lias been delivered; measurements of the properties 
of the item, for example, hardness, chemical competition, tensile strength, 
or modulus of elasticity; measurements of performance, for example, 
duration of useful life or rate of output; and so forth. The lot quality 
then is measured by n fractions defective, say p\, pz, , Pn- 

Suppose that n criteria of the form 

i + Ars < U (95) 

are applied to a single sample of N. The probability that the lot will 
pass all n fce.sts cannot be read from the OC curve for any one test. For 
a given sot of values pi. pt, the probability that a lot will be 

accepted cannot be more than the smallest among the n values of Lpy 
it wll be this large if, and only if, tlic n tests are perfectly correlated, so 
that a lot passing any one test is certain to pass all. At the other extreme, 
the probability of acceptance may bo zero; it will be this small if a Jot that 
passes one test is certain to fail some other, or if Lp is zero for any of the n 
values of p.* 

* It might be thought that these two extreme cases would never be encountered in 
practice. Specification writing and acceptance test designing being what they are, 
this is not the case. The author cherishes the memory of one particular specification 
for a cylindrical tube. It specified length, inside diaiactcx, outside diameter, con- 
centricity, weight, density, absence of voids, and ail the details of chemical composi- 
tion, physical properties, and manufacturing processes that determine density. Such 
a specification must be, at least in some degree, either redundant or inconsistent; this 
particular one perhaps bad been redundant originally, but through an encrustation of 
changes made in one detail at a time it had become inconsistent. It would bo naive 
to assume, however, that because no material could meet the acceptance criteria none 
was accepted. On the contrary, all of lb waa^ accepted. This was achieved partly by 
the buyer’s reasoning that the product was needed, that the acceptance testa failed 
to pass usable material, and that therefore materia] failing to pass the tests was usable; 
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Between these two extremes of perfect positive correlation and 
perfect negative correlation among the tests is the case in which the tests 
are independent. In this case, the probability of accepting a lot of quality 
Pi, p 2 , . . . , Pn is ^ven by the product of the individual probabilities of 
acceptance: 

.... Pi. “ ^pi * Lpi Lj,^ (96) 

Since ^ch Lpt is 1 or less, this product is less than the least among the 
set of n. If n = 3 and each Lp( = 0.95, the product is (0.95)* or 0.857; 
if each Lpi = 0.99, the product is (0.99)* or 0.970. For n = 10 the cor- 
responding products are 0.599 and 0.904. (When Lpf is near 1 and n is 
not too largo, the probability of rejecting is about n times as large for n 
independent tests as for one.) 

Sometimes the situation is that for good quality the various tests are 
independent but that for poor quality the tests are positively correlated. 
Thus, if for each of five characteristics a lot has fractions defective that 
pve it a 95 percent chance of acceptance on the individual tests, its 
chance of passing all five tests is about (0.95)® or 0.774, But if its chance 
of acceptance on each individujd test is 0.10, its chance of acceptance on 
all fivo may be nearly 0. 10. Tn such situations, not only is the OC curve 
for the battery of tests lower than that for any one test, but it gives less 
sharp discrimination between good and bad lots. On the other hand, if 
the tests are independent or positively correlated for good quality but 
negatively correlated for bad quality, the discrimination^ is sharpened. 

Another aspect of the simultaneous use of several criteria like (95) jsn 
that this treats the various tests on an attribute basis, so to speak. If a 
lot just barely fails to pass one test but appears to be of exceptionally high 
quality on all other tests, it is rejected; whereas a second lot that just 
barely passes each test is accepted. It would be preferable to combine 
all the measurements on one item into a single score for that item and 
judge the lot by the scores of the sample items.* 

All these uncertainties about the simultaneous operation of several 
criteria make the selection, operation, and interpretation of the plan much 
less clear-cut and straightfoi^vard than when only one criterion is con- 

and partly by the aeUer’s disclaiming responsibility foe the quality of the product, 
reasoning that he could take responsibility either for the quality of the product or for 
following detailed instructions for makii^ it, but not for the consistency of those 
instructions with the desired quality. 

• Chapter 3 deals with this problem. The methods presented there are new and 
have not yet been used extensively or developed to the point where they are com- 
parable with those of this chapter in simplicity of selecting plans and constructing 
OC curves, or in ease of routine operation and interpretation. They will nevertheless 
well repay careful study, especially when complicated and expensive products or 
experiments are concerned. 
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cerned. They underscore the necessity, if variables are to be used, of a 
careful preliminary analysis of a rather large body of data on the product 
to which the plana are to be applied. 

10,2. Upper and Lower Bounds on a Single Quality Characteristic 

10.2.1. General Considerations. — ^Thc OC curve for two simultaneous 
criteria of the form (96) can be determined mathematically in the case 
where the two criteria simply impose upper and lower limits on a single 
characteristic; that is, the case where an item is defective if it is either 
above some upper limit U or below some minimum M. Some mathe- 
matical investigations of this have been made,* but no completely satis- 
factory solution has yet been obtained. The indications are, however, 
that for practical purposes it will ordinarily suffice to use tAV’o criteria of 
the form (90) determined independently for the upper and lower* limits. 
Two points about this procedure, however, shouhl be recognized. 

The first point is that the combinations of x and .'j that lead to accept- 
ance are not quite tlio same when two one-sided criteria are used as they 
would be if a single tu'o-sided test were constructed. The combinations 
that lead to acceptance with two one-sided tests (having the same values 
of N and k) are includc'd in an area shaped like the triangle of Fig, 1.8, 
whereas a single two-sided test would result in rounding off the toj) comer 
of this triangle, somewhat as in the curve of Fig. 1.8. If most of the 
production should fall in the small area not common to both regions, this 
difference would be of importance. This would be a situation in which 
the mean behaved excellently, consistently lying midway between M 
and U, but the standard deviation was continually near the maximum 
value permitting acceptance uith the best value of the mean. If such a 
situation were to prevail consistently, acceptance inspectiuu ^vould 
probably be based on the stand.ard <leviation alone. 

The second point to be kept in mind in using two one-sided tests 
for a given charactoi’istic is the effect on the OC curve. The true OC 
curve for a two-sided test cannot be expressed in terms of the lot fraction 
defective alone; it depends upon the lot mean and standard deviation. A 
sample that fails to meet one criterion because of a largo standard devia- 
tion is likely to fail the other criterion also; but a sample that fails one 
criterion because of an extreme mean is likely to pass the other criterion. 

Thus, although the use of two one-sided criteria to control both upward 
and downward variation often works out satisfactorily in practice, it 
should be recognized as an improvisation for a problem that is in essential 
respects different from the one-sided problem and is less amenable to 
simple methods and interpretations. 

• The mathematical work was done in the Statistical llcssearch Group by A. Wald 
and J. Wolfowitz but has not been published. 
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10.2.2. Use of a Pair of One-sided Criteria. — Suppose two tests are 
constructed so that with one the probability is that a lot with fraction p 
{p < 0.5) above U will be accepted and with the other the probability is 
that a lot with fraction p below Jl/ \vill be accepted. If the standard 
deviation of the measurements is small, the probability is practically |S 
that a lot mth fraction p outside the limits M and U will bo accepted; but 
if the standard deviation is large, the probability is practically 0 that a 
lot with fraction 2p outside the limits M and U wall be accepted. If p/2 is 
substituted for p, the test will give the intended probability of acceptance 
for high values of the standaixl deviation but not for low values of the 
standard deviation. 

If the standard deviation is expected always to be low — it need not be 
so low when the relevant values of p are small as when they are large — 
or if lots with high standard deviations are sufficiently infrequent as to have 
only negligible effects on the operation of the tests, a pair of one-sided 
tests may be used successfully. The two acceptance criteria, both of 
which must be satisfied before a lot is accepte<l, arc then 

£ ks < U and f — > il/ (1)7) 

It may be noted that if f > (M -|- U)/2, the second inequality can be 
ignored, forit will surely be mot if the first is;similarly, if j < (Af U)/2, 
the first inequality can be ignored. 

As in the case of a single criterion, we may note that if 

X>NV or X < XM (98) 

the lot may be rejected without regard to Y, where X and Y are the sum of 
the observations and the sura of the squares of the observations, respec- 
tively, as defined by formulas (51) and (52). 

Second, we may note that if 


^ U\N - 1 ) 

- it* -1- 1 


X>N 


M + U 


the lot may be accepted. 

Third, if neither (98) nor (99) is satisfied, the lot is accepted if 




and 

r < aX^ - buX + Cc 

(100) 

or 


and 

r < aX* - bMX + C;;. 

(101) 

where 

a 

JVlk* + JV - 1 

(102) 
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bu 


Cu 


2UiN - 1 ) 

Nk^ 

U^(N - 1 ) 


bu 


2M(N - 1) 
Nk^ 


Cu 


M\N - 1 ) 

it* 


(103) 

(104) 


If neither (100) nor (101) is met, the lot is rejected. 

For adjusted observations, as defined by (71), the lot may ?)e accepted 
without regard to X if 


(U -h AyiN - 
+ 1 

i) 

when 


(105) 

(A - MYiN - 

_}) 

when 

4/ -h t/ 

(100) 

ft* + 1 


- 2 


In place of (100) and (101) we have 



and 

Y' < aX* - (bv + 2/1 )X + (cu + XA *) 

(107) 


and 

Y' < aX* - (5w + 2d)X -h {Cm + XA^) 

(108) 


The most efficient form of (105) and (lOG), either for graphical pur- 
poses or for permitting immediate acceptance on the basis of Y' alone, is 
obtained by setting 


A = 


M + V 
2 


(109) 


In this case inequalities (105) and (106) are identical. 

For either adjusted or unadjusted observations graphs may be con- 
structed as described in Sec. 7.3. The maximum value of Y for accept- 
ance for each value of X will be obtained from formula (100) or (107) 
for values of X greater than N{M + U)/2 and from formula (101) or (108) 
for values of X less than N{M -f- U)/2. In the case of adjusted observa- 
tions, if d = {M + U)/2 the figures will be symmetrical about the line 
X = NA. The upper boundaries of the error region may be found by 
formula (70) or (74) of See, 7.3. 

10.2.3. Two-sided Criterion. — A two-sided criterion is most easily 
applied if expressed in terms of a chart similar to Fig. 1.8, in whicl\ values 
of t are represented horizontally and values of 5 vertically. For each 
sample, a point is plotted corresponding to the observed i and s. If this 
point lies within the region bounded by the acceptance curve and the 
hori^iontal axis, the lot i.s accepted; otherwise, it is rejected. 

The first step in finding the boundary of the acceptance region is to 
compute k and N from formulas (10) and (11). The values of pi and pi 
now represent fractions outside the interval M to instead of fractions 
above U. 
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The second step is to find the indifference quality po, which is simply 
the probability that a normal deviate will exceed k. It may be deter- 
mined from Table 1.5. 

The third step is to divide po arbitrarily into two parts, Po and 
Vo (Po < Po) such that 

Po + Po' = po (110) 

Each pair po, p" leads to two points on the acceptance curve, so enough 
different pairs should be used to permit plotting the curve. 



Fio. 1.8, — Acceptance region for a two-sided lest defined by pi = 0.15, ps « O.^O. 
oc = O.Ol. ;3 B 0.02, U = 35, and 35; also corresponding region for a pair of one-sided 
tests. [Daia/rom Table 1.7, column* (£0. {10) and (11).] 

The fourth step is to find Kp,aiid Kp”, normal deviates exceeded with 
probabilities po and pj', respectively. These may be obtained from Table 
1 . 1 . 


The fifth step is to substitute each pair of values /fpl,, Kp‘^' into the 
pair of equations 

_ + MKp^- u _ M 


A “b A 


A’p; -b Ap 
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or into the equivalent pair 

U + M , U~M Ci-M 2 

2 2 Xp; + Kp;' * 2 A',; + A%; 

Each pair of values Kp-„ Kj^ when substituted into (111) or (112) leads to 
a combination lying on the boundary of the acceptance region ; another 
point on the boundary is given by the combination z'fS where 

x' = U + M -X- (113) 

Table 1.7 shows the compulations for the twosided acceptance region 
defined by pi = 0.15, p 2 = 0.30, a. = 0.01, and /S = 0.02, where defects 
arc represented by values below 25 or above 35. The values A' = 95 and 
k — 0.7645 are taken from Sec. 4.3. The resulting region is plotted 
in Fig. 1.8. The figure also shows the acceptance region given by using 
the pair of one-sided criteria 

X - Q.7645S >25 £ -{- 0.7645s < 35 (114) 

It will be observed that the acceptance region for the two-sided test lies 
entirely within that for the pair of one-sided tests. As x approaches U or 
M, the two boundaries nearly coincide. The difference between the 
regions is fairly sizable in this case, which involves rather laige fractions 
defective, but for smaller fractions defective the two regions more nearly 
coincide. For example, keeping M = 25 and U = 35, but taking 
pi = 0.001, pa = 0.0015, a = 0.05, 0 = 0.10 (for which Table 1.2 shows 
fe = 3.0214) we find that for x = 30 the maximum acceptable vaUie of s 
is given by the pair of one-sided tests as 1.655 and by the two-sided test a.s 

I. 550; and the difference is less for any other value of £. The effect 
of the difference between a pair of one-sided tests and a two-sided test 
should be judged by the frequency of lots I«iding to sample points that 
would signify acceptance by one test and rejection by the other. One way 
in which the two-sided test presented here is useful is in judging whether 
two one-sided tests can be used satisfactorily. 

If a two-sided test is used, criteria for reducing or tightening inspec- 
tion may also be expressed graphically. Upper and lower limits of ko 
should be computed as described in the last paragraph of Sec. 8.2.2 and 
Used as values of h from which to compute two boundary curves accord- 
ing to formulas (111) or (1 12). If the value of found in computing the 
Pa lies between the two curves, normal inspection is continued; if it falls 
below the lower curve, tightened inspection is installed; and if it falls 
above the upper curve reduced inspection is installed. 

11. TECHNICAL NOTES 

II. 1. Basic Formulas 

11.1.1. Assumptions. — Sampling plans for controlling percent defec- 
tive on the basis of variables involve dra^ving a sample of A" at random 
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from a lot and computing 

X + As 

(115) 

where 



X = 

Sx 

N 

(116) 


jvsx^ - {zxy 

171 


N{N - 1) 



X represents measurements of the variable being inspected, and fc is a 
constant. 

If X is normally distributed, x will be normally distributed with mean 
n and standard deviation where and c are the lot mean and 

standard deviation of x. Also, unless N is extremely small, say, less than 
5, s will also be nearly no rmally dis tributed, its mean and standard 
deviation being aa and hc/-\/2{N — I), respectively, where 



The factors a and b are slightly less than 1 — when iV = 5, for example, 
a = 0.940 and h = 0.905 — and they increase toward 1 as AT increases.* 
They are therefore treated as 1 throughout this cliapter; that is, the stand- 
ard deviation is regarded as normally distributed with mean v and stand- 
ard deviation <r/\/2(N -- I). 

Since a, linear comhinatton of independently distributed t'ariables 
tends to be normally distributed even when the individual variables 
depart from normality, 5 -V- ks 'viU be more nearly normally distributed 
than s; in fact, x + As wdll tend toward normality even if the distribution 
of X departs from normality. The mean of x + fcs is m + ka and the 
standard deviation is 


cr 


/I 4 - 

’N ^ 2{N - 1) 


( 120 ) 


* A table of a and 6 is given in Jennett and Welch, “C<mtrol of Proportion Defec- 
tive,” p. 85. This table gives a and 5 to 3 decimal places for values of N from .5 to 15 
by steps of 1, from 15 to 30 by steps of 5, and for 40, 50, 75, afi<l 100. A table of 
Cz = a \/ {N — \)/X to 5 decimal places for values of N from 3 to 25 by steps of 1 and 
from 25 to 100 by steps of 5 is given by Shewhart, Economic Conlrol o/ Qualily, p. 185. 
Values of Ci = a \/(A’’ — D/iV are given to 4 decimal places for values of JV from 2 to 
25 by steps of I iu Ameticm Society for Testing Material Manual, p. 50 of Supple- 
ment 1); the same table is given in American Standarfls Association, Control Chart 
Method, p. 39. 
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11.1.2. Direct Derivation. — ^The probability that in a sample x + fcs 
will be less than U then depends on the difference between U and fi + kc, 
mea.siired in units of the standard deviation of x -f- ks; that is, the proba- 
bility that X ks will be less than U is the probability that a unit normal 
deviate will be less than 


<r 


U — (n kff) 


4 


I . 

2{N - 1) 


( 121 ) 


The probability wll be t that the test will result in acceptance if 
f/ — (m + ka) 


rr 

where K. is defined by 
We may write (122) 


A;* 


= -K, = K,., 


( 122 ) 


~^2{K - 1) 


1 /■“ 


/^ / e ^di - f 

V 2ir J k4 

(123) 

^ . T.- /I . 

^ 2(N - 1) 

(124) 


{U — fj.)/c is a unit normal deviate that will be exceeded with some 
probability p, where p is the proportion defective in the lot, so we may 
write 





(125) 


Substituting this into (124) and rearranging, we find 
k = Kj. + H- 2(jv - J) 

If both sides of (120) arc decreased by Kp and then squared, a rear- 
rangement of terms gives 

(* - 2-(i^) - f ) = ° 

Denoting the coefficient of k^ by a and the term independent of A: by 6, A: 
niay be expressed in terms of N, Kp, and K, as 


k = 


Kp -t s/KI — ab 
a 


(128) 


If Kp-hk is subtracted from both sides of (126) and the equation 
1 
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multiplied by — 1, we have an equation expr^ing the fraction defective, 
in terms of a normal deviate, as a function of N, k, and e; that is, the 
abscissa of the OC curve is expressed as a function of the ordinate of the 
OC curve and of the parameters defining the sampling plan. 

Suppose we desire to choose N and k so that the probability will be 
1 — a of accepting a lot of quality pi and /S of accepting a lot of quality 
Pi, where a + $< 1 and Pi > pi. Substituting pi and 1 — a into (12C) 
gives one equation in N and k, and substituting pj and 0 gives another 


- A”! + A',_. (129) 

fc = A% + 


where K\ and Kz have been written instead of Kp^ and Kp,. After sub- 
tracting Ki from (129) and Kz from (130) and dividing (129) by (130), 
we have 


fc - A, A, -a 

k - Aj Kg 


(131) 


Solving this for k and replacing Ai-* by — A« gives 


KaKi + KgKi 

A. + A^ 


(132) 


N may then be determined by substituting k into (129) or (130) and 
solving. The solution will be considerably simpler and there will be 
little if any loss in accuracy if in the denominator of the second term under 
the radical A — 1 is replaced by N. With this approximation (129) 
becomes 

Subtracting Ai from both sides, multiplying by \/A/(Ai — k), squaring, 
and replacing Ai_a by —Ka yields 


N 

Similarly, (130) leads to 


N 



(134) 


(135) 


By adding (134) and (135) and replacing the k of the denominators by 
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(132), N may be expressed as in (12); and by substituting for k in the 
numerators as 'veil as the denominators, N may be expressed directly in 
terms of Ki, A'j, A'„, and Kfi, as in (II). 

If instead of replacing Af — 1 by JV in (129) and (130) we replace N 
by iV — 1, the right-hand sides of (134) and (135) are not affected; but 
the left-hand sides become N — 1. This approximation therefore leads 
to a value of N one unit larger than that given by (134) and (135). Since 
N must he an integer, the effects of rounding are of the same order of 
magnitude as those of replacing N — 1 hy N. It is because of this 
approximation that values^of N given by (134) and (135) that are not 
integers should be rounded up instead of to the nearest integer. If the 
approximation is not made, we find 


where 


6 -f- — I6a 

4a 



6 * fc* + 2(a -h 1) 


(130) 

« 

.(137) 

(138'' 


11.1.3. Derivation from General Formulas for Sample Size and 
Critical Level. — As an alternative derivation of formulas (132) and 
(134), we may start from the fact that x -f ks is normally distributed 
about a certain, mean in good lots and about another mean in bad lots and 
employ the ordinary procedures for testing the mean of a normally 
distributed variable. Let z represent a normally distributed variable 
whoso mean is Z and whoso standard deviatjon is a function of the sample 
size of the form 

a(i\f) - a • F(Ar) , (139) 


where F{N) is any function of N that is independent of a. Suppose a 
test is required such that the probability is a of rejecting a lot in which 
the mean is Zi and /3 of accepting a lot in which the mean is Z 2 , where 
Z 2 > Zi. The test is made by finding ^ in a sample of N and accepting 
the lot if 3 < A or rejecting it if z > A, where A is a constant. Then 
if a lot has a mean of Zi, the probability Li of acceptance is 


L, 


= ! r 


e 2-«(Ar) dz 


1 


A-Z, 



e ^ dt 


t = 


z — Zi 


(140) 


where 


(141) 
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If the lot mean is the probability L 2 of acceptance is 

1 rA (t-Zi)* 

L 2 - ^ 1 e dz 

a(A0 v^7_. 

A~Zt 

1 f •im -zi ,, 

7- • 

(142) 

whore t is defined by (141) but in terms of instead of Z\. 
priate test is then defined by values of A and N such that 

The appro- 

Li = 1 — a 

(143) 

Li = 0 

that is, 

(144) 

A — Zi 
^(N) 

(145) 

oiN) 

(146) 


On dividing (145) by (146) and solving for A , wc find 

, _ Kj:, + JCgZi 


(147) 


On multiplying both (145) and (146) by ir{N), subtracting (14G) from 
(145), replacing <t{N) by a • F{N), and solving for F{N), we find 


F{N) - 


Zi — Z\ 
a(A. H- Kf) 


(148) 


In the ordinary case of testing the mean of a normally distributed varia- 
ble, F(N) is simply iZ-y^N, and this leads to N = 1/a, whoro a is defined 
by (137). 

In applying formulas (147) and (148) to the case of percent defective, 
we have 


Z = X -\- ks 

(149) 

Z — fl fC<T 

(150) 

'y^N'^2(N - 1) 

(151) 

A lot is considered good if 


^ > A. 

(T 

(152) 

and bad if 


< A, 

(153) 


where Ki > K^. From (152), using the ccjuality sign, we find 

n = U — Ki<t (154) 
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Substituting this into (150) givejs 


Similarly; 


= f/ 4- (fc - Ki)<r 
= (7 + (fc - 


Substituting from (151), (155), and (156) into (148), wg have 


( 155 ) 

(150) 



Kt — Ki 

2{N ~ KTTIG 


(157) 


for which (136) is the solution. Substituting from (155) and (156) into 
(147) gives 


_ K^[U -hjk- Kj)^] + K4 (k - Kr)a] 

Ka "h Kfi 

K^U 4- fcr) + -4- iv) A'„A '2 4 KffKi 

+ 4 Xfl 


U->rhj - 


K^Kj 4 
X« 4 Xtf 


(158) 


(159) 


Any combination of values of k and A that satisfy this equation will be 
satisfactory values for the multiple of the standard deviation and tho 
rejection level of x ks, but most pairs will be unusable because calcu- 
lation of the rejection level A from (159) will require knowledge of <t. 
H, however, wc set 

k * — (160) 

A* 4 Kp 

this problem is solved by the disappearance of <r, and the rejection level 
becomes simply 

A ^ U (161) 


The value of k from (160) may then be substituted into (157) to deter- 
mine N. If we replace N — I hy N, the value of N given by (157) is tho 
same as that given by formulas (131) and (135), otherwise it is the same 
as that given by (136). 

11.1.4. Two-sided Criterion. — The boais for the two-sided test pre- 
sented in. See. 10.2.3 is the fact that, because I A- ks can be assumed 
symmetrically distributed about n 4 k<x, the boundary between accept- 
able and unacceptable combinations of x and .s corresponds with the 
boundary between combinations of /i and <t for which a lot has more or 
less than a 50 percent chance of acceptance. Thus, in Fig. 1.8 if the x 
and s axes are interpreted as m and a axes, any lot represented by a point 
on the boundary line has an equal rJianre of acceptance or rejection, 
that is, corresponds \vith the indifference percent defective. For the 
two-sided test it is clear that the indifference quality is the same as for a 
UTie-sided test; for when cr is very small and n is near U or M, the two- 
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sided and one-sided tests become virtually equivalent. Thus, the pro- 
cedure for finding the boundary of the two-sided acceptance region begins 
by finding the proper indifference quality pa. For any value of m, a 
value of a is found such that the fraction p^ below M plus the fraction p" 
above U is equal to poj these values of p and <r are then taken as the 
coordinates of a point on the acceptance boundary. For computa- 
tional purposes, starting Avith p and finding the proper a is cumbersome, 
but the parametric equations (IH) and (112), which start with an 
arbitrary division of po into two parts and are easily used, Given 
Po and pj', we liave 

(162) 

and 

P- + K^-<t = U (163) 

Equations (111) and (112) represent solutions of (162) and (163) for p 
and a in terms of f/, iff, Kf,\, and uii<l thus give the coordinates of a 
point :?,s on the acceptance boundary. 

11.2. Approximations in the Basic Formulas 

Four incorrect assumptions are made in deriving the preceding 
formulas: 

(1) That £ + is normally distributed; actually, it is not quite 
normally distributed, since « is not. 

(2) That a is distributed about a mean of cr; actually, it is distributed 
about a mean of a®, where a < 1 and is defined by equation (118). 

(3) That s is distributed with standard deviation <r/\/^(N ~ 1); 
actually, it is distributed with standard deviation of b(r/V2(A^ -- 1), where 

< 1 and is defined by equation (119). 

(4) That 5 is distributed with standard deviation u/y/^N. This 
assumption applies only to formulas (134) and (135) for N. 

All these assumptions can be avoided by utilizing the non-central 
t distribution, tables of which have been published by Johnson and 
Welch. In fact, the values of N and k and the corresponding true values 
of pi and p 2 given in Table 1.2 were computed with, the aid of tables of 
the non-central t distribution. The effect of the approximations in the 
form\ilas can therefore be examined by comparing the values they give 
Avith those given in Table i.2. Such a comparison exaggerates someAvhat 
the inaccuracy of the formulas because in preparing the table some effort 
Avas expended, as is explained in Sec. 11.5, to make the best adjustment 
to the discontinuous nature of IV, rather than entering the first values of 
N and k found.' Similar adjustments could be made in using the for- 
mulas. Section 4.7 includes a comparison between the results given by 
the formulas and those in Table 1.2, the comparison being made for the 
smallest sample size, namely, 6, included in Table 1.2. (It aviII be noted 
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that all four of tho incorrect assumptions underlying the formulas rapidly 
become very nearly correct as N increases.) 

TART.E 1.8 

Comparison of Approximate and Exact Values of N and k 
Thfi exact values of A; in column (2) have been computed from the non-centraJ 
t dialriliution, taking Pi 0.05, a = 0.01, and as shown in column (1). The exact 
values of p« for which ^ — 0.10 have then been computed and entered in colump (3). 
From these p 2 , taking (3 * 0.10, pi = 0.05, and® = 0.01,approximatevalue8ofVandA: 
have been computed from formulas (10) and (11) or (12). Tho true values of pi 
and Pi for which « = 0.01 and ^ = 0.10 have been computed from the non-central I 
distribution. 


Exact 

Approximate 

N 

k 

Vi 

iV 

k 

true Pi 

true P" 

(1) 

(2) 

<3) 

(4) 

(5) 

(6) 

(7) 

5 

0..5446 

0.542S 

5 

0.5150 

0.0541 

0.5519 

10 

0.8037 

0.3774 

10 

0.7856 

0.0524 

0.3830 

15 

0.9292 


15 

0.9163 

0.0517 

0.3071 

20 

1.0083 


20 

0.9083 

0.0513 

0 2633 

25 

1.0643 

0 2332 

25 

1.0560 

0.0510 

0.2344 

30 

1 . 1069 

0 2119 

30 

1.1000 

0.0509 

0.2137 

35 


0.196G 

3.5 

1.1348 

0.0507 

0.1081 

40 

1,1688 

0.1846 

40 

1 . 1633 

0,0507 

0.1859 

45 

1.1922 

0.1748 

45 

1 . 1874 

0.0506 

0.1759 

50 

1.2125 

0.IC66 

50 

1.2082 

0.0505 

0.1676 

65 

1.2592 

0,1489 , 

61 

1.2550 

0.0501 

0.1500 

75 

1.2828 

0.1404 

74 

1.2797 

0.0501 

0.1413 

100 

1.3264 

0.1266 

09 

1.3241 

0,0501 

0.1262 


Table 1.8 shows a few comparisons of the values of k and N given 
by formulas (132) and (134) or (135) with the exact values. In these 
cases a has been fixed at 0.01 and pi at 0.05. Various values of N have 
been selected and the resulting lot quality pa for which /3 = 0.10 has been 
calculated from the non-centra! i distribution. Thus the exact values of 
and k result in an OC curve passing exactly through the points defined 
by pi, a and pi,/9. If pi,a and p?,/? are both selected arbitrarily, it is not 
usually possible to find values of N and k such that the OC curve passes 
e.xactly through both points. Thus the exact values of V and k given 
in Table 1.8 are more exact than could ordinarily be achieved in practical 
problems, while those given by the formulas are characteristic of the 
accuracy realizable in practice. Columns (6) and (7) of the table show 
the true values of pi and pj for which p. = O.Oi and |3 = 0.10 when the 
approximate N and k are used. The differences between 0.05 and the 
values in column (6) and between the values in columns (3) and (7) 
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are a measure of the effect of the approximations. An alternative meas- 
ure would be the error in the true tx and at the intended pi and pzj this 
error would probably be smaller than that in pi and because the OC 
curves are usually fairly flat in the. neighborhood of pi and p 2 . While it 
cannot be claimed that Table 1.8 pves a representative coverage of all 
kinds of plans, it can be claimed that, for those comparisons given, the dis- 
crepancy between the approximate and exact results is maximized, 

11.3. Computational Formulas 

The use of the acceptance criterion 


X ks < U 


(104) 


requires the calculation of the sample mean x and the standard deviation 
fi. The acceptance criterion can, however, be expressed in terms of 
simpler functions of the observations, namely, 

X Sx (sum of the observations) (105) 

y s= Dx* (sum of the squares of the observations) (1G6) 

If h is positive, as it almost invariably will be, the lot may be rejected 
without regard to Y if 

X > NV (1G7) 

In this case, x exceeds U, so since « cannot be negative, x + exceeds V. 

The values of £ and a for a sample of N observations can be calculated 
from 


X — 


N 


and 




NSi* - (Xxy 


N{N - 1) 

In terms of X and F, equations (108) and (169) can be written 


(1C8) 

(169) 

(170) 

'N{N - 1) 

Replacing x and s in (104) by their values from (170) and (171) gives 


. X 


and 




NY - X* 




NY - 


< U 


'NiN - 1 ) ^ 

Subtracting X/N from both sides of mccpiahty (172) and squaring gives 


2XU x^ 

N{N - 1) * - ^ N ^ 


(173) 
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Clearing fractions and rearranging terms gives 

Y < aX^ -bX-{-c 

where 

TVfc* + AT - I 

2U(N - 1) 
Nk^ 

U\N - 1 ) 



(174) 

(175) 

(176) 

(177) 


If inequality (174) is fulfilled, the lot is accepted; if inequality (174) is 
not fulfilled, the lot is rejected. 

Using the equality sign in (174) gives the equation of a parabola 

= rtX2 - bX + c (178) 


which shows, for each value of A”, the maximum value of Y permitting 
acceptance, that is, the upper boundary of the acceptance region or the 
lower boundary of the rejection region. 

The minimum value of the curve Yr gives a value of Y below which 
the lot is acceptable without regard to A”. Differentiating (178) with 
respect to X gives 

^ = 2oX - h (179) 


dVR 


Setting equal to zero and solving for X gives 


Since 



dX* 


2o > 0 


(180) 

(181) 


X is the value of X at which the minimum value Kb of Kr occurs. Replac- 
ing X in (178) by the value of X given by (1^) gives, after simplification, 

y. - c - ^ (182) 


Substituting the values of a, b, and c given by (175), (176), and (177) into 
(180) and (182), and simplifying, gives 


UN{N - 1) 
Nk--\- N - \ 
C7W(X - 1) 
~ Nk^-\- N - I 


(188) 

(184) 


The coordinates of the minimum point, X — A' and Y — Yr, can be 
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approximated by replacing by N the N — ] in the denominators of 
(183) and (184) 

Approximate X ^ i^ ~ ^ ' (^85) 

Approximate F# = (186) 


These approximate values are smaller than the exact vmlues since they 
were obtained by increasing the denominators; if, therefore, 


F < 


UHN - 1 ) 

fc* 4* 1 


(187) 


F will certainly be less than the minimum value of F«, and the lot may be 
accepted without regard to X. 

The acceptance region has a lower boundary corresponding, for each 
value of A’, with the minimum value cf F algebraically possible. The 
sura of the squares of tl»e deviations of the observations from their mean 
can be written 


s(i - $y- = rx® - 

N 

(188) 

or, in terms of X and F 

N 


1 

II 

1 

(189) 

Since 2(x -• x)^ cannot be negative, 



IV 


(190) 


Por any given sum of observ’ations X, the value of Y will be ^ when the 


sum of the scjuarcs of the deviations of the observations from their mean 
is zero; that is, when all the observations are equal. The lower boundary 
of the acceptance region, or upper boundary of the error region, is, 
therefore, 

= ^ ( 191 ) 


A sample point lying below this line would indicate a computational 
error. 

By equating F« and Ye given by (178) and (191), it can be shown 
that the lower and upper boundaries of the acceptance region meet at 
the point X = NU and F = NU^. The two curves are tangent at this 
point. Beyond it, they again enclose an area similar to the acceptance 
region; this area beyond the point of tangency would bo the acceptance 
region for a test in w'hich k is negative. 
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The graphica] procedure of Sec. 7.3. 1 consists of drawing on a cliart 
the upper and lower boundaries of the acceptance region, given by (178) 
and (191); a point representing the sample is plotted on this chart and the 
lot accepted or rejected according as the point lies within or above the 
acceptance region. This graphical procedure is impractical, however, 
when the observations are large. In this case, the range of variation in 1’ 
as X varies is large relative to the width of the acceptance region ; and the 
upper and lower boundaries of the acceptance region are too close for 
most practical purposes. 

An adjustment of the observations can be made (a) to overcome this 
difficulty in the graphical procedure or (6) to find a criterion more effective 
than formula (187) in permitting immediate acceptance. The adjust- 
ment consists of subtracting an adjustment constant A from each of the 
observations, A being chosen according to the purpose (a) or (b) for 
which the adjustment is being \ised. It is not necessary to adjust each 
observation; it is necessary only to compute the sum of the squares of 
the adjusted observations Y' from X and Y by 

Y' = Z(X - Ay (192) 

= r - 2AX A- NA^ 


Adjusting and Yb, given in (178) and (191), by (192) (that is, sub- 
tracting 2AX and adding NA^) gives the upper and lower boundaries of 
the acceptance region 

Y's - aX® - (6 + 2A)X + (c + NA^) (193) 

n = - 2A.X + NA^ (194) 


where a, b, and c are defined by (175), (176), and (177). 
It can be shown that the minimum value y'„ of Kg is 


V, _ ((/ - AyN(N - 1) 
^ “ Nk^ + X - I 


095) 


Replacing by N the iV — 1 in the denominator of Kg gives the simplified 
criterion for immediate acceptance 


~ -h 1 


(190) 


If the graphical procedure is used, the adjustment constant A should 
be chosen so as to minimize the variation, in K as X varies over the region 
of likely sample values. Tbi.s flattens the cjirves defining the acceptance 
region, thus enabling the acceptance region to encompass a larger 
portion of the chart’s area and thereby improving the accuracy of 
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plotting. To determine the optimum value of A, consider the slope of 
V'e at a given value of X 


dX ~ IVf, 


(197) 


For a given value of X, the slope is zero U'hen A = X/N. The optimum 
value of A depends, therefore, on the observed value of X. If before 
the sample is inspected is the best estimate of the mean of the char- 
acteristic being inspected, the optimum value of A, for graphical purposes, 
is 

X = m' (198) 


since the e.xpected value of -Y is Nn'. 

If the graphical procedure is not used, the adjustment constant A 
should be chosen so as to maximize the effectiveness of formula (196) in 
permitting immediate acceptance. This involves finding the value of A 
that minimizes the Y corresponding to the minimum value Y' = Yg. 
Differentiating (193) with respect to X gives 


Since 


ftyf 

^ = 2aY - (6 + 2A) 


d^Y' 


dY' 


dX 


^ = 2a > 0 


(199) 


( 200 ) 


setting equal to zero and solving for X gives the value of X at which 
Yg is a minimum, namely, 

( 201 ) 


The value of Yg calculated from (193) for tho point whose abscissa is 
given by (201) is the minimum value of 

n = - + (c + (202) 

The value of given by (195) can be obtained from (202) by replacing 
a, h, and cby their values given by (175), (17G), and (177). Finding the 
value of Y corresponding to Y' = I'g, that is, adding 2AX to, and sub- 
tracting JVA^ from, (202) gives 


7 = - + (c + JVA^) + 2AX - (203) 


(f? + 2A)^ 

4a 


+ c + 2AX 


Now, the optimum value of A is that value which makes the 7 corre- 
sponding to the minimum value 7^ as large as possible, since, for a given 



Sec. 11.4.1 


VARIABLES 


71 


value of X, if Y is less than the value given by (20S), the lot is accepted. 
Differentiating (203) with respect to A gives 




Since 


setting ^ equal to zero and solving for A gives the value of A at which 
K is a maximum, namely. 


d-r 

dA^ 


= - - < 0 


(204) 


(205) 


A ^ aX 


(206) 


The value of A given in (206) is a function of X, so the optimum value of 
A depends on the observed value of X. If before the sample is inspected 
fi' is the best estimate of x, the anticipated value of X is Replacing X 

in (206) by its anticipated value gives 


A = aNu' - ^ 


(207) 


Replacing a and b in (207) by their valu^ given by (175) and (176), and 
simplifying, gives 

^ m 


Replacing by N the iV — 1 in the numerator of (208) gives 

Approximate A = ~ ^ (209) 

Using the value of A given hy either (208) or (209) makes (196) very 
nearly the most effective in permitting immediate acceptance. In terms 
of Y, replacing the A in (203) by (207), and simplifying, gives the linear 
condition for acceptance 

y < c' - b'X (210) 

where 

V = h-2Nti’a (211) 

c' = c - JVV^a (212) 

and a, b, and c are defined by (175), (176), and (177). 

11.4. Use of Ron-central i Distribution 

11.4.1. Introduction. — ^The acceptance criterion 

X -\- ks < U 


can be written 


U -X 


(213) 
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The quantity (C/ — a)/s is a function of the sample data and fc is a 
constant; using the acceptance criterion (214) is thus equivalent to com- 
paring the value of tlie sample statistic (t7 — x)/s with a minimum level 
for acceptance k. 

If many samples of N obseiwationa are chosen at random from the 
same population (or lot), the values of (JJ — x)/« obtained from the 
various samples will vary. The proper determination of k requires a 
knowledge of the sampling distribution of (U — x)/s. 

The distribution of the quantity t, defined as 

t = VN (216) 

is known as the non-central t distribution, of which the familiar Student's 
I distribution is a special case corresponding with = U. Tables of the 
non-central ( distribution with an explanation of their application to the 
problems considered in this chapter have been given by Johnson and 
Welch. 

11.4.2. Notation Used in the Tables. — It will be necessary to use the 
notation of Johnson and Welch to explain the application of their tables 
to the problems discussed in this chapter. The following list indicates 
the changes in notation:* 


1 

This chapter 

Johnson and Welch 

Value of variable that defines quality 1 

U 

L 

Sample statistic 

• 8 

8 

Acceptable level of statistic 

k 

Uo 

Normal deviate corresponding with proportion 
p defective in lot . . ' 

K, 

1 U 

Normal deviate corresponding with probability « 
of accepting a lot 

\ 

1 A' 


* A word of explanation is in oixlcr about our departure from the John«>n-\\>lci^ 
and Jennett-Welch notation, since their notation is saliafoctory and established. 
Throughout all three of our volumes the letter L is consistently used to represent the 
ordinate of an OC curve; as a substitute U has the mnemonic advantage of association 
with "upper limit.” It eeema unnecessary to use two symbols for the normal deviate, 
since the type of subscript (Greek letter, numeral, and so forth) can discriminate 
between normal deviates defining quality and those describing operating charac- 
teristics. For thesamplestatistic, ^accords with thoJot pstrameterK. Logic suggests 
a subscript for the acceptable level of the statistic, and Johnson and Welch use 0; but 
because the acceptable level enters the analysis so frequently and other values so 
seldom, we use no subscript. Logic also suggests a subscript for a particular observed 
value of the statistic, and we use a. 
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In the notation of Johnson and Welch, the acceptance criterion (214) 
becomes 

M > «a ( 216 ) 

Let 2 be a quantity distributed normally about zero with unit standard 
0 deviation, and let ty be a quantity distributed independently of z and 
in the same way as an estimate of variance computed from a sample 
from a normal population containing / degrees of freedom. That is, w 
is distributed as x^/f with / degrees of freedom. If t is defined by 


t = 


g+ g 

v/ty 


(217) 


Avhere 3 is some constant, then I has the non-central i distribution, 
depending only on the eccentricity 3 and the number of degrees of freedom 
/■ 

To see that the statistic u is closely related to the non-central t distri- 
bution, consider the distribution of values of u from random samples 
of N observations from a normal population mth mean n and standard 
deviation <t. Suppose that e.xactly a proportion p of the items in the 
population exceed a given limit L and that U is the standardized normal 
deviate exceeded with probability p, that is, 


1 



e ^ dr 


V 


( 218 ) 


het f and s be the sample mean and standard deviation, respectively 
Then, in the notation of Johnson and Welch, u can be written as 
(217) with 


- - u) 

a 


(219) 


~ ( 220 ) 

/ = - 1 ( 221 ) 

5 = VN U ( 222 ) 


Hence, -\/N u is distributed as a non-ccntral I ^^ith / = iV — 1 and 
5 = VN XL 

The distribution of non-ccntral t requires a triple-entry table, since 
the probability that t exceeds a given level <o depends on /, 5, and 
This probability is denoted by Johnson and Welch also use 

i(/,5,€) to denote that value of /o for which the probability P(/,3,/o) 
takes a specified value €. The value of 5 that makes = e is 

denoted by • 

11.4.3. Description of the Tables. — ^The? problems for which the noq- 
central t tables are used in this chapter require the evaluation of either 
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6(f,to,€) or Tabic IV given by Johnson and Welch facilitates the 

direct calculation of these for 17 probabihty levels corresponding with € 
and 1 — e equal to 0.005, 0.01, and 0.025, 0.05, 0.1, 0.2, 0.3, 0.4, and 0.5. 
In Table IV, a quantity X = X(f,fo,€) is given such that 


and 


— X 



t(JM = 


I *2 \2 

2 / - 


(223) * 


(224) 


Equations (42) and (21) of this chapter are essentially appro.ximations for 
equations (223) and (224), respectively, with X in (223) and (224) 
replaced by the normal deviate exceeded with probability <. Even 
for small samples, it is fo\md that X docs not differ much from 

Table IV consists of nine' double-entry panels (one for each of the 
values of e listed above) showing X as a function of / and to. Values of X 
are given corresponding to / = 4, 5, 6, 7, 8, 9, 10, 36, 144, and <» . In 
order to simplify interpolation for intermediate values of / greater than 9, 
thft values of / = 9, 16, 36, 144 and are s^ich that 12/-\^ = 4, 3, 2, 1, 
and 0, respectively; that is, X Is ta!)led at equal intervals of 12/V7- 
The whole range of from — co to « is covered as follows: For h/y/^ 
between — « and —0.75 or between +0.75 and + », X is tabled against 
the quantity 


1 



(225) 


For io/\/^ between —0.75 and +0.75, X is tabled against 


^0 

y' - (220) 

if 

11.4.4. Calculation of 5(/,<o,<)* — For given /, to, and € < 0.5, the steps 
required for the calculation of 3(/,to,€) are given below. For e > 0.5, 
the relation 

HIM = -S(/,-<o,l - (227) 

is used. That is, if 5(9,12,0.95) is required, calculate 6(9,-12,0.05) 
by the procedure outlined below and take the negative of this vahie as the 
required value of 5(9,12,0.95). 
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according as 


Step 1. Calculate to/‘s/2f. 

Step 2. Find y = — . or i/ = — according as 

^ Vl +tl/2f ^ Vl + il/2f 

1 ^0 

IS greater than or less than 0.75. 

Step 3. If f is greater than 9, calculate 12I\/J. 

Step 4. From the panel of Tabic IV corresponding with the given e, 
obtain X — X(/,<o,e) by interpolating with respect to the 
quantities obtained in steps 2 and 3. 

Step 5. Calculate 5(/,Io,e) = to — \ V^l 

11 . 4 . 5 . Calculation of t(f,S,(). — The calculation of i(/,5,e) is accom- 
plished by an iterative method, since X is given in Table IV as a function 
of ^ 0 . The successive steps in the iterative method for calculating t(f,S,€) 
for given /, S, and e < 0.5 are given below. For e > 0.6, the relation 

- - 0) (22S) 

is used. That is, if ((^,5,0.90) is required, calculate ((9, — 5,0.10) by 
the procedure outlined below, and take the negative of this value as the 
required /(9, 5, 0.90). 

*Si^ep 1. Determine A”,, the normal deviate exceeded with probability 
e, which can be found in Table 1.1. 

Step 2. Calculate the first approximation i, from 




«S/ep 3. 
Step 4. 


Step 5. 
Step 6. 


Step 7. 


Calculate t\fy/2j. 

Find y = — . * or y' = according as 

\/r+ (1/2/ ^ Vl + t\/2f 

— A- is greater than or less than 0.75. 

If / is greater than 9, calculate Yljy/J. 

From the panel of Table IV corresponding with the given 
e, obtain Xi = X(/, <!,«)- by interpolating with respect to the 
quantities obtained in stefjs 4 and 5. 

Calculate a second approximation U from 
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Step 8. Repeat steps 3 through 7, replacing ti by h, and calculate a 
third approximation ti. Repeat these steps until two suc- 
' cessive approximations are the same ; usually not more than 

two approximations are required. Take for the value 

so obtained. 

11.4.6. Illustration of the Use of the Non-central t Tables in Specific 
Problems 

Problem I. Given: N, pi, « (in our notation, N, pi, 1 — a or 
Required: uo (in our notation, k) 

A single-sampling plan based on variables is defined by a sample size 
N and a value uq of the statistic u. If N is fixed, uo can be dcternilued so 
that the operating-char.actcristic curve for the plan passes through a 
specified point (Pi,e); that is, for a fixed sample size, a plan is chosen for 
which the probability of accepting lots of quality pi is e. 

For given N, pi, and «, the value «o that defines the plan is given, in 
the notation of Johnson and Welch, by 

VNua = t(N - 1 ,VNUi,€) '(229) 

where Ui is the normal deviate exceeded with probability pj. Thus, for 
a given sample size N, (jualily (fraction defective) pj, and probability 
of acceptance the deteimination of uo requires the calculation of 
where / = -- 1 and 6 = -y/NUi. 

An outline of the method for determining wo for given values of N, 
Pi and « is given below. 

Given: N *= sample size 

pi *= a proportion defining quality 
e = desired probability of accepting lots of quality pi 

Determine Ui, the normal deviate exceeded with probability 
pi, from Table 1.1. 

Calculate 

f = N-l 
5 = ^/NU, 

Step 3. Calculate by the method described in Sec. 11.4.5. 

Step 4. Calculate Uo = 

Problem II. Given: N , wo, « (in our notation, AT, fc, Lp) ‘ 

Required: p 

For every single-sampling plan (defined by N and Mq), there is an 
operating-characteristic (OC) curve which shows the probability c of 


Step 1. 
Step 2. 
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accepting a lot of quality p. From the Johi^on and Welch tables we can 
compute the values of p correspondirig to £ or 1 — c equal to 0.005, 0.01, 
0.025, 0.05, 0.1, 0.2, 0.3, 0.4, or 0.5. This requires finding 5(/,^o,e) where 
f= N — i and i^q = -s/Nuo. The value of U corresponding to this value 
of 5 is b/y/N. The value of p corresponding to the given e is then the 
probability that a normal deviate will exceed this C/, which may be found 
from Table 1.5. 

Ste'p 1. Calculate 

U - y/Nua , 

Siep 2. Calculate 5(/‘,fo,«) by the method described in Sec. 11.4.4. 

Step 3. Calculate U = 

Step 4. Obtain the required p by entering Table 1.5 with K equal to 
-the value of U found in step 3. 

11 . 4 . 7 . Work Sheets. — Suppose that the sample size is fixed at 30, 
and a plan is required for which a lot having 0.1 percent defective ^vill 
be accepted with probability 0.99. That is, N = 30, pi = 0.001, and 
e — 0.09. Work sheets 1, 2, and 3 (Tables 1.0, 1.10, and 1.11) represent 
the calculations necessary to determine u®; work sheet 4 (Table 1.12) 
represents those for the OC curve. The numerical entries have been 
rounded from calculations originally carried to more decimal places, so 
they do not ahvays agree exactly with operations carried out on the 5-deci- 
mal-place figures shown. 


TABLE 1.9 

Work Sheet 1 foh Determining «» (in Our Notation fe) from Non-central t 

Tables 


Row number 

(1) 

Operation 

(2) 

Result 

(3) 

1 

Example 

(4) 

(1) 

Given 

Pi 

0.001 

(2) 1 

Given 1 

e 

0.99 

(3) ' 

Given 

N 

30. 

<4) 

Table 1.1 

t/i 

3.09023 

(5) 

V(3) ' 

Vn ' 

5.47723 

(6) 

(3) - 1 

/ = N - 1 

29. 

(7) 

(4) X (5) 

« = Vn t/i 

16.92590 

(8) ^ 

Sheet 2, row (14), , 
last column I 


12.47223 

(9) 1 

(8) - (5) 

u. 

y/N ! 

2.27711 
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TABLE 1.10 


Work Sheet 2 eob Determining uo — Computation of 



Operation 

Result 



number 

approximation 

approximation 

(1) 

(2) 

(3) 

(4) 

(5) 

(1) 

Sheet 1, line 6 

/ 

29 

*- 

C2) 

Sheet 1, lino 7* 

5 or —4 

-16.92590 

<- 

(3) 

Sheet 1, line 2* 

« or 1 — « 

0.01 


(4) 

.2X(1) 

2/ 

58 


(5) 

(2)» 

5» 

286.48600 

— 

(6) 

(5i (4) 

2» 

2/ 

4.93941 

- 

(7) 

Table 1.1 

K, 

2 . 32035 

2.321t 

(8) 

(7)* 

K,* 

5.41190 

5.38704 



Kt* 



(9) 

1 (8) + (4) 

'v 

5* Kt* 

0.09331 

0.09288 

(10) 

1 1 + (0) - (9) 

, 1 J 

' ^2/ 2/ 

5.84611 

5,84654 

(11) 

V(To) 

.V ^2/ 2/ 

2.41787 

2.41796 



' / 



(12) 

(2) + (7) X (11) 


1 -11.30109 

-11.31381 



/<■«* 



(13) 

1 - (9) 

l - — 

2/ 

1 0.90069 

0.90712 

(14) 1 

(12) 4- (13) 

i “ 

1 -12.46410 

-12.47223 

(15) 

VC4) 

VT/ 

7.61577 


(16) 

(14) 4- (15) 

i 

VTf 

-1.63662 

1 -1.63768 

(17) 

(14)* 


155,35379 

155.55660 

(18) 

(17) -f (4) 

f* 

2f 1 

2.67851 

1 

2.68201 

(19) 

1 + (18) 


3.67851 

3.68201 

(20) 

VlW 


1.91795 

1.91886 

121) 

1 (30) 


0.52139 

0,.52]14 

(22) 

(16) -P (20) 


X 

t 

(23) 

VoT 

V7 

5,38516 

*- 



12 



(24) 


V? 

2.22834 


(25) 

Sheet 3, row (l7). 

X 

2.321 

2.321 


last column 


i 



* Since t > 0.5, we change the sign of # and replece « by I — 

t The figure in row (7), coiunin (5) is the valuo of Xi given in row (25), column (4) and is used in 
place of Kf in the succeeding calculations for Xi. 

t No figures are given for y' in this example because > 0.7.5. 
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TABLE 1.11 

Work Sheet 3 for Determining «o — ^Linear Interpolation for \{a,b) 



Operation 

llcsult 



number 

approximation 

approximation 

( 1 ) 

( 2 )_ 

(3) 

(4) 

(5) 

( 1 ) 

Sheet 2, line 21* 

a 

0.52139 

0.52114 

( 2 ) 

Sheet 2, line 24* 

b 

2.2283 

2.2283 

(3) 

Table TV* 

Oi 

0.5 

0 5 

(4) 

Table IV* 

02 

0,6 

0.6 

(5) 

Table IV* 

6 i 

3. 

3 

( 6 ) 

Table IV* 

bt 

2 . 

2 . 

(7) 

(3) - (1) 

ui — a 

0.2139 

0,2114 

(3) - (4) 

ai ^ ai 

( 8 ) 

(1) - (4) 

a — 02 

0.7861 

0.7886 

(3) - (4) 


oi - at 



(9) 

(5) - (2) 

(5) - ( 6 ) 

, b, -b 

b, - 6 , 

0.7717 

0 7717 

( 10 ) 

( 2 ) - ( 6 ) 

(5) - ( 6 ) 

, b-bt 

_ h, 

0.2283 

0 2283 

( 11 ) 

Table IV* 

All 

2.318 


( 12 ) 

Table IV* 

Alt 

2.324 


(13) 

Tal.le IV* 

Ail 

2.310 


(14) 

Table IV* 

Att 

2.318 


(15) 

{8)(11) + (7)(13) 

CtXii + C 1 X 21 

2.31629 

2 31631 

(16) 

(8)(12) + (7)(n) 

C 2 X 12 + CiXii 

2.32272 

2.32273 

(17) 

(10)(15) + (9)(16) 

X(a 6 ) 

“ <it{ctXii + C 1 X 51 ) 
+ JiCCiXii -b CiXji) 

2.321 

2,321 


* For the given «, Xie a funotioa of/andr«end ie given in Johnson and Wtsich's Table IV, for Biievirii><l 
values of y (or y') and / (or 12/ -yj). a and 6 ore the values of the arjfumentB (in this case y and 12/%//. 
resFieciively) (or wlilch X is required, ai, oi, bi. and are llie values of the arguments for which Table 
IV gives X values and between which we interpolate to find X(a,6). Xii, Xit, Xti, and Xri are the tabular 
values corresponding to di. <ti, bi, and bt. The following scheme explains the notation i 



The computation of the OC curve for the above plan is illustrated by 
finding the values of p for which Lp is 0.2 and 0.7. The figures given in 
Table 1.12 represent the calculations necessary to determine the values of 
p corresponding with these two values of Lp. Additional columns would 
be required for additional points on the OC curve. 
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TABLE 1.12 

Work Sheet 4 for Operating-characteristic Curve 


(1) 

(2) 

(3) 

(4) 

(5) 

Row 

number 

Operation 

Result 

First point 

Second point 

(1) 

Given 

Lp 

0.2 

0.7 

(2) 

Smaller of Lp and 

f 

0.2 

0.3 


1 - Lp 




(3) 

Sheet 3, lino 1, last 

a 

0.52114 

«- 


column 




(4) 

Sheet 3, line 2, last 

b 

2.2283 

«- 


column 




(5) 

Sheet 3, row 3* 

i 

0.6 

0 5 

(6) 

Sheet 3, row 4* 

at 

0.5 

0.6 

(7) 

Sheet 3, row 5 

hi 

3. 

4— 

(8) 

1 Sheet 3, row 6 

Ih, 

2 

4— a 

(9) 

(5) - (3) 

ai — a 

0.7S8fi 

0 2114 

(5) - (6) 

Oi - dj 

(10) 

(3) - (6) 

a — lit 

0.2114 

1 0,7886 

(5) - (6) 

'■* at — at 

(11) 

(7) - (4) 

b,-b 

1 0,7717 


(7) - (8) 

1 ‘ 5i - bt 

1 

(12) 

' (4) - (8) 

(7) - (8) 

1 . 6-6, 

” 6, - bt 

1 0.2283 

4-^ 

(13) 

Table IV t 


0.9125 

0.4318 

(14) 

Table IVf 

6i, 

0.8899 

0.4632 

(15) 

Table IVf 

Xii 

0.9192 

0.4408 

(16) 

Table IV t 

x« 

0.8W5 

0.4691 

(17) 

(10)(13) + (9)(J5) 

+ ClX,l 

0.91778 

0,43370 

(18) 

(10)(14) + (a)(16) 

c*Xi* + CiX,, 

0.893.53 

0. 46445 

(19) 

(12) (17) -h (U) (18) 

X(a6) 

= d,(ctXu + ciXti) 
+ di(ctXi: 4* C|X,,) 

0.8991 

1 

0.4574 

(20) 

Sheet 2, row 14, last 

u 

12.47223 

-12.47223 


column t 




(21) 

Sheet 2, row 20, last 

1 

1.91886 


column 

\ "^2/ 

4— 

(22) 

(20) - (19) X (21) 


10.74699 

-13.34992 

(23) 

(22) if « = L, 

- (22) if < = I - Ly 

5 

10.74699 

13.34992 

(24) 

Sheet 1, row 5 

Vx 

5.47723 

4-^ 

(25) 

(23) d- (24) 

II 

1.9C2I2 

2.43735 

(26) 

Table 1.5 

[p 

0 0249 

0.0074 


* The interchange of ai and oj m column (4) ia ntade for cotusistency with the interpolation scheme of 
sheet 3. 

t Use the panel of Talile IV that correnponds with the value of e given in row (2)- Note that the 
portion of Table IV where ( is positive is used for column (4) and the portion wiiere { is negative is used 
for column (S), 

If only and ua are given and no preliminary calculations are available from work sheets for 
determining ua by the exact method, then sheet 4 nuut be eupplemented by a eheet oonaiating of rows 
(14) through (24) of eheet 2. with! taken as and /taken as N — 1. 
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Sec. 11.5 

11.5. Coastrvction of Table 1.2 

Problem. Given: pi, ps, a, and /3 
Required: N and k 

A single-sampling plan based on variables is defined by a sample 
size N and a value k, the multiple of the standard deviation in the criterion 
X ks < U for accepting the lot, where U is the value above which the 
characteristic being inspected is regarded as defective. If no restrictions 
are imposed on sample size, a plan can be constructed for which the 
operating-characteristic curve will pass through two specified points. In 
practice, the first point often corresponds with a lot quality pi (AQL) for 
which it is desirable that the probability of rejection should be only a 
(producer’s risk), and the second point corresponds with a lot quality 
Pi (LTPD) for which it is desirable that the probability of acceptance 
should be only {3 (consumer’s risk). 

Consider the family of all 0(^ curves that pass through the point 
(pi,l — a) but which have diffenng values of N". If N is small these 
curves decline gradually as p increases from p», and if N is large ‘they 
decline sharply. There will be one OC curve among the family that 
passes closer than any other curve to the point (p?,^). Since N takes 
only integral values, there usually will be no curve that passes exactly 
through (p2,/3) . A curve could, however, be made to pass exactly through 
(p 2 ,^) if it were allowed to deviate from (pi,l — a). Table 1.2 has been 
constructed In such a way that the OC curves generally pass not exactly 
through either (pi,l — a) or (p*,0) but very close to both. The distance 
of the OC curve from the intended two points has been measured hori- 
zontally, that is, by the difference between the actual and intended 
qualities for which the probabilities of acceptance are 1 — a and 

'Flie vafucs of* A' and’ fc m ‘rable t.'I were obtained' ih three stages: 
(1) obtaining a first approximation to N and k; (2) determining the degree 
to which the preliminary values of N and k satisfy the requirement that, 
the OC curve pass througli (pi,l — «) and (pa, 0); and (3) adjusting N 
or k to improve the approximation. 

Step 1. From pi, p 2 , a, and determine A'l, Ki, and Kp, the 
normal deviates exceede<l with probabilities pi, p 2 , a, and 
respectively, as given by Table 1.1. 

Step 2. Calculate the first approximation to k from 

, KaKi + KpKi 

* “ A'„ + Kp 


Step 3. 


Calculate an approximate sample size N from/ 


N = 


fc* + 2 
2 
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Step 4. By the method given in Sec. 11.4 for determining the quality 
p corresponding to a specified probability of acceptance Lp, 
determine pi_a and pp where 

p\^a — tiic quality for which the probability of acceptance 
is 1 — a 

p^ = the quality for which the-probability of acceptance 
is 

If pi^ and p^ are sufficiently close to pi and p^, respectively, 
then the values of k and N given by steps 2 and 3 define a 
satisfactory sampling plan. 

Step 5. If the <liscrepancy between pi_a and pi or that between p^ and 
P 2 is too large, determine a better plan by adjusting either N 
or k according to the follo\ving rules: 

a. If Pi-« is greater than pi and p» is less than p 2 , take the 
next lower integer for N and the same k, and repeat step 4. 

b. If Pi-« 13 less than pt and p^ is greater than pi, take the 
next higher integer for AT and the same k, and repeat ^ 
step 4. 

c. If pi-a is less than pi and pf is less than p 2 , use the same 
N and a smaller value of )c, and Ttjpeat step 6. 

d. If pi-a is greater than pi and ps is greater than p 2 , use 
the same N and a larger value of Jt, and repeat step 6. 

These rules can be applied regardless of the method used for finding 
the first approximation to k and N. When these are found by steps 2 and 
3, however, rule d usually be applicable. 

Calculate the bettor appro.ximation for k mentioned in (c) and (d) 
from 

. _ 4 - ^zKj 

Xi + X2 

where 

Xi = value of X computed in determining pi_a in step 4 
Xa = value of X computed in determining pp in stop 4 

Step 6. For the required N and k, take the pair of values for which 
pi-a and pp are close enough, or closest, to the given values of 
Pi and p 2 , respectively. 

Table 1.2, which gives values of N and k for various combinations of 
Pi and p 2 when a = 0.05 and /? = 0.10, was constructed by essentially 
the method described above. For each plan in Table 1.2, except that 
for Pi = 0.05 and Pi = 0.40, the true values of pi and p 2 agree exactly 
with the intended values when rounded to the number of decimal places 
wth which the intended pi and pt are given in the table; in many cases 
the agreement is much better. Minor improvements could, no doubt, be 
made in many cases. 
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11.6. Sequential Analysis of Proportion Defective by Variables* 


The fact that 


z = ks 


(230) 


can be taken as approximately normally distributed with mean and 
standard deviation approximately 




Z = 

fi hr 

(231) 

and 


c(N) = 

aFiN) 

(232) 

where 

4 

F{N) = 

ji 

yjN ^ 2{N - 1) 

(233) 


may be made the basis of a sequential procedure for controlling percent 
defective by means of variables. 

For a lot of acceptable quality, that is, one in which the mean of z 
is Zi as defined by (155), the probability density of z is given by 

P(z\Z,) - (234) 

<r(iV) \/2ir 

Similarly, for a lot of unacceptable quality, that is, one in which the mean 
of z is Zi as defined by (156), the probability density of z is 

Piz\Zi) = — / (235) 

c(N} v2jr 


A sequential test is made by computing X after each observation, 
where 


and rejecting the lot if 
accepting it if 


X = log. 


P(z\Zi) 

Piz\Zi) 


X > a 


X < -5 


(230) 

(237) 

(238) 


* See Chap. 17 for a brief accuuiil of sequential analysis and for references to the 
fundamental work on this subject, the theory of which was developed in the Statistical 
Research Group by A. Wald. An exact treatmentof proportion defective problems by 
sequential analysis of variables involves the ratio of densities of two non-central 
i distributions. Henry Goldberg has shown that this may bo expressed in terms of a 
confluent hypergcometric function, tables of which were prepared for the Statistical 
Research Group by the New York IMathematical Tables Projoct in a form suitable 
for use in sequential analysis. There is in preparation an additional section for 
Sequential Analysis that will include these tobies and an explanation of their use. 
The present section simply outlines a sequential procedure based on the approxima- 
tions used elsewhere in this chapter for single sampling. 
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~b < \ < a 

(239) 

where 


1 > - 
a = log* - 

a 

(240) 


(241) 


a being the probability of rejecting a lot of quality Zi and ^ the proba- 
bility of accepting a lot of quality Zi. Each calculation of X is based on 
all observations. 

To obtain X, we take the logarithm of (234) and subtract it from the 
logarithm of (235), which yields 


Substituting for Zv and Zt from (155) and (15G) and for(T(iV) from (232), 
and rearranging, gives 


Ki — Ki r ,, /, Ki -1- 

- 7[Fov)F u ^ r 2 )\ 

which may be rewritten as 


(243) 


= ^ + (244) 


This \vill be independent of c if 
k 


A', + Ki \\F{N)Y 

2 Ai - Ki 


(245) 


On substituting for F{N) from (233), there results a quadratic in k for 
which the solution is 

Vl - AB - 1 


where 


and 


k = 


A = 


B = 


A 


(N - l)(iCi - Ki) 
2X 


A(Ai - Ki) 


~ (Ax A- Ki) 


(246) 

(247) 

(248) 


For each value of N, two values of k are obtained from (246), the 
first, by replacing X in (247) and (248) by a, and the second, k^, by 
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replacing X by —h, where a and h are given by (240) and (241).* Then 
after each observation both 


and 


2r = X + Jcrs (249) 

za ~ X -\- fcxs (250) 


arc computed. If zr > U the lot is rejected. If 2 ^ < [7 the lot is 
accepted. If neither condition is fulfilled, another item is inspected, 
new values of x, s, ka, and are computed from all the observations, and 
new values of zr and are compared with LT. 

An alternative computational procedure is to compute ko after each 
observation, where 

fj X 

k. = (251) 


then if ko < kx the lot is accepted, if > fc* the lot is rejected, and if 
kA < ko < kg another item is inspected. 

The values of fcx and kg depend upon N, pi, pz, a, and &. In any one 
problem all of these but N arc fixed, so a table showing and kn for various 
values of hf can be prepared in advance. If pi = 0.15, pz — 0.30, a = 0.01 
^5 = 0,02, and N — 95, the values of fc* and A:x are 0.0051 and 0.8930, 
respectively, t For a single-sampling plan, the corre.sponding value o 
k was found in Sec. 4.2.2 to be 0.7045. For the sequential plan, if no 
decision had been reached from the first 94 observations, rejection would 
occur if for tho first 95 observations £ + 0.00515 > V and acceptance 
would occur if X + 0.8930 < C/;ifneithcrcondition were fulfilled, another 
observation would be made. From the data in Sec. 7.2.2, where £ 
= 30,232, 3 = 5.000, and U = 35, we find Zb = 33.56, which, being less 
than 35, does not call for rejection; and Za = 34.70, which, being less 
than 35, calls for acceptance. 


12. NOTATION 

The arrangement is alphabetical, the sequence of listing under each 
letter being as follows: first Roman, then Greek letters; within these 

* Tables of a und b in terms of a and 0 arc given in Statistical Research Group 
Sequential Arialysis, Tables 4.2, 5.1, 6.1, and 7.31. These give a and b to Z decima 
places for values of a and 0 of 0.001, 0.01 to 0.05 by steps of 0.01, 0.05 to 0.20 by steps 
of 0.05, and 0.20 to 0.40 by steps of 0.10. 

t From the unpublished tables referred to in the footnote at the beginning of Sec. 
11.6, which are based on the likelihood ratio computed from two non-central 1 distribu- 
tions, the corresponding values of ItA and Icr are found to be 0 6630 and 0.8S93. For 
kg = 0.6651 and Ua = 0.S930, the true values of « and 0 arc. respectively, 0.0110 and 
6-0177, which differ by 9.6 and 11.7 percent from the intended values, U.Ol and 0.02. 

these two OC points lie below (to the left of) those intended, whereag with 
single sampling the true points generally lie above (to the right of) those intended 
(see Table 1.8). 
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groups, first capital, then small letters; within these groups, first those 
\\'ithout, then those with, primes, bars, or carets; ^vithin these groups, first 
those without subscripts, next those with literal subscripts (follo'wing 
the same sequence as for letters), and finally those with numerical 
subscripts (in numerical order). Certain symbols, notably a and h, are 
used in a variety of different meanings that occur only locally; in such 
cases the listing is in order of first appearance. Section 11.4 employs the 
notation of Johnson and Welch, which differs from (and in some respects, 
for example, U and L, contradicts) that used elsewhere in the chapter. 


Symbol 

' See 

Meaning 

.1 

p. 37 

.A.n adjustment constant subtracted from 
<‘acii observation 

A 

p, 61 

1 

Critical value of 2 for accepting or rejecting 
a lot * 

A 

1 p. S4 

equations (246), (247) 

A function of x, N, K i, and K 2 that appears 
in formulas for the sequential procedure 

AQL 

pp. 11. 45 

Acceptable quality level (see pi) 

u 

pp, 10, 20 

equations (21), (22) 

Function of N aiid Ka that appears in the 
formula for k when is fixed 

a 

p. 61 

equations (X36), (137) 

Function of A’l, Kx, Ka, and that 

appears in the formula for iV 

a 

p 35 

equations (55), (56) 

Coefficient of quadratic term in condition, 
quadratic in X, for acceptance in terms 
of r 

a 

p. 58 

equation (118) 

Multiple of 0 in formula for mean of dis- 
tribution of 8 

a 

pp. 83, 8-1 
equation (240) 

A critical value of X in a sequential test on 
the basis of which the lot is rejected or 
another observation is taken 

a 

p. 16 

I’roduccr’s risk. Probability that a lot of 
acceptable quality (pi or AQL) will be 
rejected 

B 

p. 8-1 

equations (246), (2-18) 

A function of X, N, K 1 , and Kt that appears 
in formulas for the sequential procedure 

b 

pp. 19, 20 
equations (21), (23) 

h'unction ot A, /v ,, and K a that appears in 
the formula for k when N is fixed 

b 

p. 35 

equations (55), (57) 

Negative of coefficient of linear term in 
condition, quadratic in X, for acceptance 
in terms ot Y 

b 

p. 58 

equation (110) 

Multiple of — 1) in the formula 

for standard deviation of distribution of s 

6 

p. 61 1 

equations (136), (138) 

Function of k and a that appears in the 
formula for N 

b 

pp. 83, 84 1 

equation (241) 1 

1 

A critical value of x in a sequential test on 
the basis of which the lot is accepted or 
another observation is taken 
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Symbol i 

See 

Meaning 

bu 

pp. 53, 54 

Value of b obtained from equation (57) by 


equations (100), (103) 

replacing U by M 

bo 1 

pp. 53, 54 

Same as 5 given by equation (57) ; subscript 


equations (100), (103) 

U used to distinguish bu from bu 

b' ' 

p. 41 

Negative of coefficient of linear term in 

1 

equations (78), (79) 

condition, linear in X, for acceptance in 
terms of Y 

/3 1 

p. 16 

Consumer’s risk. Probability that a lot of 
unacceptable quality (p 2 or LTPD) will 
be accepted 

c 

p. 35 

Constant term in condition, quadratic in X, 


equations (55), (58) 

for acceptance in terms of V 

Cm 

pp. 53, 54 

Value of c obtained from equation (58) by 


equation (104) 

replacing (7 by AI 

Cy 

pp. 53, 54 

8aiDC as c given by equation (5S) ; subscript 


equations (100), (104) 

U used to distinguish cy from Cu 

c’ 

p. 41 

Constant term in condition, linear in X, for 


equations (78), (80) 

acceptance in terms of V 

7 

p. 43 

A proportion (0 < y < 1) denoting a 
conOdcocc coefficient 

7, 

p. 44 

Confidence coefficient used in judging 
whether to continue normal inspection 

7, 

p, 44 

Confidence coefficient used for judging 
whether to resume normal inspection 

S 

p. 73 

Johnson and Welch notation for a constant 
appearing in the numerator of non*central 


p. 73 

Johnson and Welch notation for the value 


Sec. 11,4.4 

of 4 that makes P(f,S,ia) =* e 

« 

p. 17 

A probabilitv (0 < « < 1): probabilitv 


equation (9) 

that a normal deviate will exceed AT* 

€ 

p. 73 

Johnson and Welch notation for probability 
of acceptance 

F(N) ; 

p. 61 

Any function of N that is independent of v 

/ 1 

p. 73 

Degrees of freedom of x* 

A 

p. 42 

Number of lots from which samples are 
taken and combined into one large sample 
for the purpose of computing the process 
average 

K 

p. 9 

{U — a) A- That is, the difference be- 
tween the upper limit and the population 
mean, as a multiple of the population 
standard deviation 


p. 17 

Normal deviate exceeded with prob- 
ability a 

iCjs 

p. 17 

Normal deviate exceeded with prol)- 
ability (3 

Kt 

Ip. 17 

Normal deviate exceeded with prob- 
ability € 
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Symbol 

See 

Meaning 

A’o 

p. 21 

Normal deviate exceeded with prob- 
ability Pa 

Ki 

1 

p. 17 

Normal deviate exceeded with prob- 
ability Pi 

Ki 

p. 17 

Normal deviate exceeded with prob- 
ability Pi 

k 

p. 12 

Coefficient of the sample standard devia- 
tion Id the acceptance criterion 

X + ks < U; 

also, acceptable level of statistic k,. 

kA 

p. 84 

Acceptance level for fe® in a sequential test 

ka 

p. 43 

(U — £)/s. That is, the observed differ- 
ence between (' ami the sample mean in 
units of the sample standard deviation; 
sample estimate of K 

kg ' 

p. S4 ' 

Rejection level for fc® in a sequential test 

k‘ 

p, 48 1 

■y/n times the coefficient of the sample 
standard deviation in the acceptance 
criterion,* + {k'/\/n) 8 < U', used when 
items are eventually assembled in sets of n 

Hy 1 

p. 47 

Uoper confidence limit for A’, based on a 
confidence coefficient of y 

^T»? 1 

1 

p. 45 

Lower and upper limits, respectively, 
between which a computed value of ko 
leads under normal inspection to con- 
tinuing normal inspection, based on a 
confidence coefficient of Vi 

1 

p. 45 

liOwer and upper limits, respectively, 
between which a computed value of fc® 
leads under reduced or tightened inspec- 
tion to resuming normal inspection, based 
on a confidence coefficient yr 

L 

p. 72 

Johnson and Welch notation for the upper 
limit of a variable, above which an item is 
defective; corresponds with our U 

T.TPD 

pp, 22. 45 

^JO^ tolerance percent defective (sec pa) 

Lp 1 

p. 15 

Ordinate of an OC curve at abscissa p. 
Tli« probability that a lot of fraction 
defective p will, if submitted to a given 
acceptance t<»t, be passed 


p. 16 

Value of an OC curve at /t, a-. The prob- 
ability that a lot of mean /x and standard 
deviation <r will, if submitted to a given 
ai’ceptance t^t, be passed 

U 

p. 61 

Probability that a lot having mean Z| will, 
if submitted to a given acceptance test, 
be pa^cd 
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Symbol 

See 

Meaning 

In 

p. 62 

Probability that a lot having mean Z* will, 
if submitted to a given acceptance test, be 
passed 

X 

p. 83 

Xatural logarithm of the ratio of two 
probability densities, computed after each 
observation in a sequential test 

X = X(/’,toj<) 

p. 74 

Johnson and Welch notation for a function 

eqiialions (223), (224) 

of /, to, and' « used in the calculation of 
fi(/.f*.«) iind f(/,6,e) 

Xi 

p. 82 

Value of X computed in determining pi_a 

X| 

p. 82 

Value of X computed in determining 

M 

p. 13 

' Alinimum value of a variable, below which 
an item is defective 

h 

P 0 

Population mean of a normally distributed 
variable 


p. 41 

Best estimate of i available before the 
sample is inspected 

N 

p. 12 

Number of items in a sample 

Aa 

p. 26 

Sample size for single-sampling plan for 
percent defective based on atributes 

A. 

p. 43 

Number of items in the ith sample of a 

(I = 1, • • • , M 


group of h samples 


p. 27 

Sample size for single-sampling plan for 
percent <lefectivc based on the mean when 
the standard deviation is known 

A, 

p, 28 

Sample size for single-sampling plan for 
percent defective based on the standard 
tlcviation when the mean is known 

A, 

p. 27 

Sample size for single-sampling plan for 
percent defective based on the mean and 
standard deviation when both are un- 
known but estimated from sample 

A’ 

p. 48 

Number of sets of n items in a sample 

n 

p. 48 

Number of items constituting a set which 
is judged defective or not on the basis of 
the average for the sot 

n 

p. 50 

Number of variables upon which the 
quality of an item depends 

oc 

St-c. 3.4 

Operatingcharacteristics. The probability 

PA 

Sec. 6 

that a given acceptance lest will pass lots 
of various qualities if submitted 

p. 42 

Process average percent defective 


p, 73 

Johnson and Welch notation for the prob- 
ability that t exceeds a given level (« 

for given / and 5 

^C3|Z.) 

p. 83 

Probability density of z for lot in which the 

^(2120 

equation (234) 

mean of z is Z i 

p. 83 

Probability density of z for lot in which the 


equation (235) 

mean of z is Zt 
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Symbol 

See 

Meaning 

Y* 

p. 36 

equation (70) 

Boundary between error and acceptance 
regious when values of X. are plotted 
liocizotLtally and values «>f 1’ veclically; 
minimum value of Y that can be obtained 
for any given value of X 


p. 36 

Boundary between rejection and nocept- 
anee regions when values of X are plotted 
horizontally and values of Y vertically; 
parabola dcHiied by equation (55), using 
the equality sign 

r' 

p. 37 

^ equation (71) 

Sum of squares of adjusted observations, 
that is, observations from which a 
constant has been subtracted 

I'i 

Ip. 37 1 

' equation (74) 

Boundary between the error and accept- 
ance regions when values of X are plotted 
horizontally and values of Y' vertically 

yk 

p, 37 1 

equation (73) 1 

Boundary between the rejection and 
acceptance regions when values of X arc 
plotted horizontally and values of Y' 
vertically 

I'r 

p. 07 

equation (184) 

Minimum value of the cun'e Yr; a value of 
}’ below which the lot is acceptable with- 
out ivgard to X 

n 

p. 69 

equation (195) 

Minimum value of the curve a value of 

Y' below which the lot is acceptable 
without regard to X ' 

y 

p. 74 

equation (225) 

Jolinson and Welch notation for a function 
of to and /, one of the nrgumentb against 
which X ia tabled 

V' 

p. 74 

equation (226) 

Johnson and Welch notation for a function 
of to and /, one of the arguments against 
which X is tabled 

z 

p. 61 

Population mean of the normally distri- 
buted variable s 

Zi 

p. 61 

Value for Z foe which it is required that the 
probability of rejection be a 

Zi 

p. 61 

V'alue of Z for which it is required that the 
probability of acceptance be 0 

z 

p. 61 

A normally distributed variable 

z 

p. 73 

Johnson and Welch notation for a variable 
distributed normally about zero with unit 
standard deviation 

lA 

p. 85 

i + kAS 

zr 

p. 85 

X -Y ktts 
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CHAPTER 2 


TOLERANCE LIMITS FOR NORMAL DISTRIBUTIONS 

1. NATURE OF TOLERANCE LIMITS 

1.1. Definition of Tolerance Limits 

A common method of specifying the quality of manufactured product 
is to set a range, the bounds of which are caDed “to]eraiice limits/’ such 
that a certain percentage of the product made under commercial condi- 
tions may be expected to have a quality falling between the limits. For 
example; tolerance limits may be placed on dimensions to indicate the 
extent of interchangeability of parts. Tolerance limits are also used 
in other fields, for example medicine and psychology, to indicate the 
range of. normal variation in various characteristics. In general, toler- 
ance limits are limits within which lie a certain percentage of the indi- 
viduals of a statistical universe. 

The satisfactory application of tolerance limits requires that assign- 
able causes of variability be delected and eliminated so that the remaining 
variability may be considered random. In other words, prediction from 
past data of the proportion of future observations that will be contained 
within fixed limits assumes that the successive values of the quality 
characteristic in question may be considered randomly chosen from a 
statistical universe.* 

1.2. Class of Tolerance Limits Considered 

The tolerance limits considered in this chapt.er are symmetrical about 
the iflcan, and they are based on the assumption that the underlying 
statistical universe may be described by a normal distribution. When 
the true mean and standard deviation (l and <r of this normal distribution 
are known, tolerance limits are formed by adding to and subtracting from 
the mean a certain multiple K of the standard deviation; the appropriate 
multiple is easily obtained from tables of the normal distribution and 
depends only upon what proportion of the universe is to be included 
within the limits, t Values o£ K corresponding to various proportions 

* A, detailed discussion of Ibe nature, use, and practical basis for tolerance limits 
may be iound in Sbewbart. Slalinlienl Method, Chap. If, pp. iSO-rQ. In fact, th« is 
the original source on which subsequent work on tolerance limits has been based. 
(For fuU citations, see Sec. 4.) 

t See Chap. 1, Sec. 2. for further discussion of this point. 
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included within the tolerance range may be found entering Table l.l 
of Olup. I with < equal to half the proportion. For exanipJe, 90 

percent of the population is included in the interval p — 1.645 <t to 
ii -f l.6i5tf, since 90 percent inclusion corresponds uith 10 percent 
exclusion, or < — 0.05. 

In most practical situations the true values m and cr are not known, 
and toJeram.’c limits must be estimated from the mean X and the standard 
deviation 5 of a sample of N obsCTvations. \Vliile the limits ^ i 1.645 p 
will imdude 90 percent of the universe, clearly the same assertion canuot 
be made of the limits X ± 1.645s. The proportion included between the 
limits .Y ± Ks depends, for example, on whether the sample mean is 
tuiusually large, reasonably close to the population, mean, or imusuaily 
wnnll. The sample standard deviation Is also .subject to chance fluctua- 
tions that aSoct the projxirtion included between the limits. In fact, if a 
value of K is fixerl, no two s.amp)es from a given universe will lead to 
Iho same toluranc© limits, since both X and s will vary from sample to 
sample. 

It is clear then that the proportion of the universe included between 
the limitf. X± is a random variable, and that it is impossible to 
determine K so that the limits will altt'ays contain a specified proportion 
P of the universe. It is possible, however, to determine K in such a way 
that in a targe icries of samples from normal universes a certain propor- 
tion y of the intervals X ± Ks wll include P or more of the universe; 
7 ie called " the confidence coefficient,^' since it is a measure of the cons- 
cience ^vith which we may assert that a given tolerance range includes at 
least of the universe. 

Intuitively, it seems reasonable that the values of K for use with 
sample means and standard deviations nill be somewhat larger tiian the 
values used if the true mean and standard deviation are known. In 
fact, by taking K very largo the probability that the interval X + Ks 
will contain at least P of the universe may he made as close to J as is 
desired. Since the Iciigth of the tolovanco intorval is ^Ks, the smaller K 
is, the more meaningful and the less trivial a tolerance range is, The 
position i. 5 , therefore, oiio of being able to state broad generalities with 
little risk, of error, or to make more precise statements at greater risk. 
The problem is to find the smallest factor K that may bo associated with a 
specified cenfidenee coefficient 7 , proportion P, and sample size X. 
Table 2.1 presents such factors for various combinations of 7 , P, and iV. 
Beforo discussing the use of Table 2.1, it is desirable to contrast the tol- 
erance limits it yields with other kincb of limits. 

1,3, Other Kinds of Limits 

1.3.1. One-sidedsToleraoce Limits. — lu^ead of specifying a two- 
sided interval that will contain a certmu percentage of the product, it 
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%vill frequently be appropriate to specify a one-sided limit such that a 
fixed percentage of the product will have a quality greater than (or a 
quality less than, as the case may be) this limit, rroblems of this sort 
may be solved by the methods of Chap. 1, Sec. 9.2, 

1.3.2. Multivariate Tolerance' Limits. — Certain methods of setting 
tolerance limits have been generalized by Wald and by Paulson to the 
problem of setting simultaneous limits on several quality characteristics 
of a single item. In this connection, see also Chap. 3. 

1.3.3. Tolerance Limits for Non-normal Distributions. — Wald has 
considered the problem of setting tolerance limits on the basis of large 
samples for distributions of any known form, normal or otherwise. 
Application of these tolerance limits to normal distributions gives unsatis- 
factory results; their applicability (us contrasted with their theoretical 
correctness when N approaches infinity) to other forms of distribution 
has not been determined. 

1.3.4. Distribution-free Tolerance Limits. — Sometimes it is desirable 
to set tolerance limits without making any assumption about the form, 
normal or otherwise, of the underl 3 nng distribution. Problems of this 
sort have been discussed by Wilks and by Wald. The problem of deciding 
whether to use tolerance limits based on the normal distribution, tlioso 
based on some other distribution, or those which involve no assumption 
about the form of the distribution is one which, though of a kind common 
in applied statistics, has no satisfactory solution. Tolerance limits basetl 
on the normal distribution are substantially shorter for a fixed sample 
size than those based on no assumption about tlie distribution; but they 
may be irrelevant if the underlying distribution is too far from normal. 
The decision about the adequacy of the normality assumption may bo 
based upon an analysis of measurements of a large number of items; it 
may be supported by theoretical considerations, for example, when the 
quality characteristic is known to be determined by many chance causes 
whose effects are essentially additive; or it may rest on a combination of 
theoretical and empirical evidence. It should be noted that if there is a 
stable universe from which the measurements are random observations, 
limits of the form X + Ks will, in a fraction y of samples, include a 
certain proportion P' or more of the universe, where P' differs from the 
intended P by an amount depending upon the departure of the true 
distribution from normality.* 

1.3.5. Confidence Limits.— Tolerance limits should not be confused 
with confidence limits (or with fiducial limits) for the mean or other param- 
eters of the distribution. Confidence limits for the mean, Avhich also 
are of the form X ± Ks, are computed in such a way that in a fraction 
y of the samples from which they are computed they will include the mean 

* For a fuller and more precise statement of this point, see Chap. 1, See. 9.4, 
including the quotation from Jennett and Welch. 
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TABLE 2.2 

COJSFnciENTS TO FACILITATE THli UsB OP FonMUHA ( 6 ) FOR CoSIPUTINO K N Ja 

Labhb 


Coefficient 1 

1 Value 




mm 

Term in 

VY 

Term in -77 I 

N 1 

! ^ 

5zy» + 10 
12 

0.4700 

1 0229 

0 9062 1 
1.5177 1 

1 1631 

1 . 9606 

1 1.0450 

3. 0883 


3. CONSTRUCTION OF THE TABLE 

3.1. Formula 

The formula for K used in Table 2.1 is* 


-■'VI 


(13) 


where iV is the number of observations, P is the proportion of the distri- 
bution to be included within the tolerance limits, y is the confidence 
coefficient, r is a function of l/\/N and P defined by 


/“vT? 

V^J -L-p 


+r «* 

e^^dt 


(14) 


and Xr is defined by 


W 

Pix^ > X?) = T (15) 

in terms of the chi-squarc distribution for n degrees of freedom, whore 

« = AT - 1. (26) 


3.2. Basic Network of Points 

K was computed directly from formula (13) for all values of n (that 
is, of N — 1) from 1 to 30, for all even values of n from 30 to CO, for 
values of n from 60 to 200 at intervals of 10, and for values of n from 199 
to 999 at intervals of 50. For other values of n, values of K were inter- 
polated into tins basic network of points by means of 4-point Lagran- 
gian interpolatory coefficients taken from the table published by the New 
York Mathematical Tables Project. 

3.3. Percentage Points of x* 

For all values of n from 1 to 30 and for values from 30 to 100 at 
intervals of 10, the percentage points of x* were obtained from Thomp- 

• This forrrmia was developed in. the Statistieftl Research Giovip by A. ^Vaid and 
J. Wolfowitz; see their paper cited in Sec. 4. 
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son’s tabic. Since ior even n the probability of exceeding any given value 
X® is ‘given by the partial sum of a Poisson series, the required values 
between n = 30 and n = 60 (except n = 40 and n = 50) were obtaine<l 
by inverse interpolation in Molina’s table* using Salzer's inverse inter- 
polation coefTicients. Tbe percentage points of n > 100 were found 
from a Cornish-Fisher type of expansion applied to the distribution. t 

3.4. Computation of r 

To compute r, Newton’s method was applied tr) the function 

a(T) = f dt-P ^0 (17) 

v2)ry _l 

y/N 

The NYMTP tables of the probability integral are conveniently 
arranged for this, since the ordinates of the noTinal curve are tabulated 
beside the integral, and forward interpolation in both the integral and 
the ordinate may bo expressed simply in terms of the ordinate. 
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CHAPTER 3 


MULTIVARIATE QUALITY CONTROL, ILLUSTRATED 
BY THE AIR TESTING OF SAMPLE BOMBSIGHTS 

1. INTRODUCTION 

1.1. Type of Problem 

Systematic plans of sampling for acceptance inspection or quality 
control are for the most part based on simple features of the individual 
articles inspected. Usually each article is classified merely as defective 
or nondefective. In a minority of cases there is a finer classification 
involving measurement of continuous variates. In the inspection of 
simple articles, including component parts of complicated assemblies, 
inspection by attributes is considered appropriate; but in tlio inspection 
of complicated assemblies, especially when inspection is costly, measure- 
ments are apt to be advantageous.* Furthermore, the performance of 
complicated assemblies is usually a function of several different variables. 
When several quality characteristics are measured, there arises a problem 
of combining the several measurements on each article into a single 
measure (“score” or “index”) of the over-all performance of the article. f 
In the absence of a formally defined procedure, methods of a more or 
less subjective character for combining the different measurements to 
form , a judgment of degree of acceptability are bound to develop. The 
simplest such method is to apply customary practices to each variate 
separately and to reject whenever the usual rules applied to any one 
variate alone lead to a verdict of rejection. This procedure, however, 
has the effect of changing drastically the probabilities, both of accepting 
what i.s bad and of rejecting what is good. For example, if a sampling 
scheme is designed to give a probability of 0.05 of rejecting a lot of a 
certain quality on the basis of measurements of one variate, and if this 
scheme is applied to each of two variates measured on the same articles, 
then if the two variates are independently distributed, rejection on the 
basis of one or the other variate will take place in 9.75 per cent of sub- 
mitted lots of the given quality instead of 5 per cent as originally con- 
templated. The discrepancy between the actual and the intended 
probabilities of rejection will increase rapidly .with the number of inde- 
pendent variates when such a rule is followed. 

* For a further discussion of this point, see Chap. 1, Sec. 1. 
t For a further discussion of this point, see Chap. 1, Sec. 10.1. 
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An alternative rule, erring in the opposite direction, would be to 
accept any lot for which the univariate scheme applied to any one of 
the variates calls for acceptance. Thus rejection would require that all 
the variates take such values as to call for rejection. For two inde- 
pendent variates, a probability of rejection intended to be 0.90 would 
actually in such a case be only 0.81. 

These probabilities can be adjusted so as to become equal to 0.05, 
or such level as is chosen, by altering the acceptance level for each variate 
separately. However, this brings in additional difficulties. The variates 
may not be mutually independent, and then calculations such as the fore- 
going must be altered to take into account the multivariate distribution. 
Furthermore, it will often not be known whether they are independent or 
not; or if they are mutually dependent, the character of the dependence 
may be known only imperfectlj'. Thus the correlation coefficient may 
have to be estimated from a preliminary sample of size so small as to 
leave its exact value somewhat uncertain. Any acceptance probabilities 
based on such a correlation coefficient will then like^visc be uncertain. 

Rules such as those suggested above have another defect. An article 
close to the margin of acceptability mth respect to one variate may well 
be marked fer acceptance or rejection on the basis of the other variates 
involved. Unusual excellence in one respect may often atone for a slight 
departure in another way from what would othenvise be considered 
satisfactory. A formula is then needed for combining the measures in 
the several dimensions into a single measure of excellence, or of adherence 
to specifications or to a desired ideally uniform set of dimensions. Such 
a formula should give a measure of departure from the ideal that will 
increase with a departure in any dimension. It should lend itself to an- 
exact interpretation in terms of probability, taking account of the neces- 
sarily limited size of any preliminary sample used to determine the 
parameters entering into the formula. 

Formulas of this type are here developed on the basis of an expression 
kno^vn as the generalized Student ratio T, introduced in 1931 for tho 
testing of hypotheses about the location of the means of multivariate 
distributions and closely related to the e.xponent in the multivariate 
normal distribution.* If errors in two or more dimensions were mutually 
uncorrelated and of equal variance in the sample representing past 
experience, the value of T for a new individual would be directly pro- 
portional to the distance from the point whose rectangular coordinates 
represent the ideal to the point representing the actual measurements. 
Thus, for a bomb dropped on a target, T would in such a case be simply 

• See IIoTEU-iJJG, "The Generalization of Student^s Ratio.'' (For full citations, 
see Sec. 6.) 
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the distance of the bomb from the center of the target, expressed in terms 
of a unit equal to the standard deviation found in the earlier experience. 
Actually, the variances of range errors in bombing are appreciably less 
than those of deflection errors.* Consequently, the e.xpression used for 

has different coefficients for the two squared terms. In addition, it 
has a term in the product of range and deflection errors, the small coef- 
ficient of which re.?ult.s from a slight correlation between the two kinds of 
error in the available experience. This serves as a measure of the 
deviation of the particular bomb from the center of the target, a measure 
more accurately interprctable in terms of probability than is the actual 
distance. By adding the values of 7’* for all the bombs dropped with a 
particular bombsight, we have a measure useful in judging the accuracy of 
that bombsight. There are also other ways of combining these T’s to 
throw light on particular features. 

A great advantage of all these T statistics is that, in samples from 
normal distributions, they have probability distributions that can be 
determined exactly. Many statistics have distributions involving what 
may be called nuisance parameters,'' that is, parameters which are not 
known exactly from general considerations or basic scientific constants 
but have to be estimated, with more or less uncertainty, from fallible, 
observations. This is true, for example, of the actual distance of a 
bomb from a target, whose distribution depends not only on the mean 
value of such distances but also, and in a complicated way, on the direction 
of the deviation. The parameters specifying the distribution of the 
direction — which is really irrelevant — are nuisance parameters in the 
distribution of the actual distance, confusing its interpretation as a 
measure of accuracy of the bomb. But the T statistics have been con- 
structed in such a way that there are no nuisance parameters involved in 
their distributions, at least as long as we are dealing with data from a 
fundamental distribution of the normal form. 

It is to be expected that these T statistics will have many applica- 
tions in sampling inspection and in other fields. In particular, wherever 
a manufactured article is to be judged, not on the basis of measurement of 
parts, but on the basis of final performance as measured by several vari- 
ables, there seems to be room for the utilization of such methods. A case 
of this kind, which is here considered in detail and for which the methods 
presented here were originated, is that of air testing sample bombsights. 
It is presented here as a precedent that ndll be useful in other situations 
in which final performance is determined by multiple measurements. 

• An error in range U an error in the direction of the airplane’s heading at the 
time of release. An. error in deflection is an error in a direction perpendicular to the 
plane’s heading. 
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The mathematical theory is not given in full in this chapter, but the 
methods recommended will, it is believed, be fully intelligible on the basis 
of the material presented here.* 

Besides the T distribution, several other innovations are here sug- 
gested, both grapliic dft\nces and methods of applying to statistical 
quality control some of the ingenious devices and concepts that R. A. 
Fisher has introduced into the design of experiments. 

1.2. Problems of Air Testing Bombsights 

The dropping of bombs from airplanes for the purpose of testing 
bombsights submitted by manufacturers is a phase of quality control. 
The art and the literature of quality control, so greatly expanded of late, 
are to a certain extent applicable to this bombing procedure. Yet test 
bombing presents several novel features that make the situation very 
different from those heretofore dealt with in the literature and usual prac- 
tice of quality control. These peculiar features, which make this no 
ordinary problem and render the usual methods inadequate and to some 
extent inappropriate, are the following: 

(1) In contrast to the simple articles to which routine mass sampling 
inspection is usually applied, with at most one or two numbers recorded 
for each article tested, and often merely a “good'’ or “bad” verdict, the 
bombsight is a highly complex instrument with a multiplicity of parts, 
each of which is subject to various possible defects. 

(2) The process of putting together these parts in selective assembly, 
matching an oversize part with an undersize part to lit in with it, grind- 
ing and adjusting when necessary, is a series of jobs requiring great skill, 
whose results are to be judged by the performance of the finished instru- 
ment rather than by measurement of parts. Performance, however, is a 
complicated thing. If quality is to be measured by performance and 
expressed by one or a few numbers, caution must be exercised in the 
choice of these numbers and their interpretation. 

(3) Air testing is only one of a series of tests and inspections to which 
a bombsiglit and its parts are subjected. It is the final step, and an 
exceptionally costly one. For elimination of defects the main reliance 
is properly placed on earlier and cheaper steps. A great deal of careful 
screening out of defectives has taken place prior to the final stage of air 
testing, with which alone this chapter is concerned. 

(4) The errors of test bombing are not by any means due entirely to 
defects in the sight. In spite of all attempts at standardization there are 
bound to be variations in the weather, the altitude from which the bombs 
are dropped, the bombs themselves, the airplane, the auxiliary equip- 

* It is planned to present the mathematical theory in the Annals of Mathematical 
Statistics. 
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ment, and the personnel engaged in flying, bombing, and observing the 
results. The variance in the results of the bombing that results from 
causes having nothing to do with the quality of the bombsight indicates 
that, while valuable statistical inferences are possible from large numbers 
of cases, it would be a dubious procedure to take any drastic action on the 
basis of the four or six bombs usually dropped udth a sight, except perhaps 
in the most extreme cases. 

(5) When bombing with a particular sight shows unsatisfactory 
results, the action ordinarily taken is not the rejection of the sight, but 
its adjustment or repair. 

(6) Whereas the usual sampling inspection for quality control is 
carried out verj’ cheaply for each single inspection by a workman of 
moderate skill using some simple in.strument, the di'opping of a test bomb 
requires a pilot, a bombardier, an airplane uith gasoline and maintenance, 
an airfield, a target area, stations for observing the point of impact and 
personnel to man them, and finally, plotting and computations. 

The function of air testing is clearly not the elimination of individual 
bad sights or of bad lots of 10 from which the sights tested are taken. 
This is done far more efficiently by inspection of parts and by shop testing 
of the finished bombsight, both by the manufacturer and by the govern- 
ment representatives at the factory, as well as by the shop testing of the 
sample sent to the government proving ground. The principal functions 
which air testing is capable of fulfilling appear rather to be the following: 

(1) Keeping a running record of quality designed to compare the 
work of different productive units, and of the same unit at different times. 

(2) Detection of irregularities, trends in quality, and deviations from 
customary levels in the average performance of sights produced over a 
period. 

(3) Exploration of possible types of defects, either in design or in 
production, not previously recognized. 

(d) By experiments carefully designed so as not to conflict with the 
other purposes of air testing, to obtain judgments on differing models 
of sight.s, on auxiliary equipment, on bombing methods, and on personnel 
in a manner more efficient than separate experiments carried out solely to 
obtain these judgments. 

The high cost and uncertainty of air testing, with the relative accuracy 
and low cost of shop testing, indicate that only a very small number of 
bombsights should be air-teste<l. However, it does appear that some air 
testing should go on, for reasons outside those usual in sampling inspec- 
tion and to an extent that cannot be determined by calculation according 
to customary methods. In the specific, though flexible, plan suggested 
in Sec, 2, the amount of routine bombing called for is one-twentieth 
of that under procedures in effect in 1943 The exact proportion s\utable 
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cannot be derived by calculation from the proportion of defects, which 
could not be ascertained reliably from the record because of the virtual 
absence of defects serious enough to cause rejection. The fraction sug- 
gested represents what is in the author’s view a reasonable proportion of 
bombsights to be tested if the improved statistical methods described 
herein are utilized. The plan can easily be modified, in accordance with 
Sec. 3, to fit any other proportion considered appropriate. 

In much quality-control work where individual inspection is cheap, 
inefficient statistical formulas are used frankly and <leliberately when they 
are easy to calculate and to comprehend. The saving in computation 
represented by using the meaii deviation instead of the standard devia- 
tion ^ith many small batches may in some circumstances offset the 
increase of approximately one-eighth in the amount of inspection neces- 
sary to get the same accuracy. The range of a sample (that is, the differ- 
ence between the greatest and least of the values) is often taken as a 
measure of dispersion when it is felt that the inability of factory employes 
to understand any more sophisticated measure warrants the cost of the 
additional observations required to obtain the necessary accuracy. 

Considerations of this kind should have no place whore the unit cost 
is as great as that of dropping a bomb. Information acquired at such 
great expense should not be wasted by the use of inefficient statistical 
methods of combining the observations. One object of this chapter is to 
set forth the most appropriate methods of combining the observations of 
the bomb coordinates and of making inferences from them. Some modi- 
fications of the usual kinds of control charts are introduced. Further- 
more, the contribution of modern statistical method.s to the improvement 
of accuracy is not limited to formulas for combining the observations after 
they are made. Certain precautions, such as proper randomization and 
replication, can be arranged only before tlio observations are made. The 
application of these principles to air-testing sample bombsights by a plan 
in accordance with modern principles of experimental design is another 
leading purpose of this chapter. 

Section 2 consists of a specific plan for the selection of sample bomb- 
sights, their air testing, the calculations to be made from the results, a 
series of control charts of new types, and some simple considerations 
relevant to interpretation of the results and to action. 

Since Sec. 2 is easily adaptable lo changed couditioiis and modifica-i 
tions of the plan, formulas are given in Sec, 3 for calculating new control 
limits and other needed quantities under conditions more general than 
those of Sec. 2. Provision is here made for changing the number of bombs 
dropped per flight, the number of flights with each sight, the number of 
eights to be taken from a lot for air testing, and the base period with which 
comparison is to be made. 
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While Secs. 2 and 3 consist principally of simple rules for operating 
and for amending the sampling plan, Avith little mathematics or argu- 
mentation, Sec. 4 gives the background and reasons for the plan. The 
chief mathematical discu.ssion has, however, been confined to a technical 
paper, where the mathematical reader will find a more precise account 
of some of the new ideas presented here for the first time. 'I'hese ideas 
are applicable to a wide range of problems, not only in quality control but 
also in connection wth bombing and firing in general, with mental test- 
ing, and with other problems in which two or more normally distributed 
variates are involved. 

Section 5 is an analysis of the results of dropping 260 ore-filled bombs. 
Measures of dispersion obtamc<I from these bombs are substituted into 
the formulas of Sec. 3 to obtain the control limits specified in the plan of 
Sec. 2, together ivith coefficients for combining range and deflection 
errors and other needed quantities. For any sampling plan, a base 
period is needed to get the plan started, and this is provided by the 
material analyzed in. See. 5. This section also contains as by-products a 
specimen rating of equipment and personnel involved in that bombing, 
essentially to show how such ratings can be made, and a new simplified 
technique of analysis of variance with une(iuai class frequencies developed 
for the purpose of making these ratings. 

This chapter includes control charts having several novel features, 
which it is believed mil also be found useful in other control-chart work. 
One is the choice of the functions combining different measures of 
accuracy, here range and deflection errors, to be plotted. These func- 
tions are invariant under transformations of coordinates and hence have 
probability distributions capable of exact determination. Another 
feature of the control charts here presented is the provision of yardsticks, 
for visual comparison of different plotted values, with a definite prob- 
ability interpretation. 

In fixing the control limits corresponding to specified probabilities, 
account is here taken of the limited number and consequent sampling 
fluctuations of the observations in the base period used for comparison. 
It is to be feared that in many control charts heretofore in use there has 
been an unconscious distortion of the probabilities because of neglect of 
this consideration, with a bias uniformly in the direction of exaggerating 
the significance of moderately large deviations from norms. Use cf 
formulas such as those of Sec. 3 in industrial quality control should cor- 
rect this error. 

2. PROPOSED SAMPLING PLAN 

2.1. Selection of Sample Sights and Arrangement of Bombing 

(1) Whenever a new factory goes into production, each of the first 
40 bombsights produced and passing the usual shop tests of the govern- 
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merit inspectors, both at the factor)- and at the proving ground, is to be 
tested. If all these are found satisfactory, the remainder of the plan is 
to be applied to subsequent production, subject to withdrawal Aidth 
reversion to the status of a new factory if later a series of unacceptable 
sights is offered. (Since the last contingency has not hitherto occurred, 
accurate formulation of a definite rule for such reversion must await the 
accumulation of this undesirable kind of expeiience.) 

(2) At each factory that has been approved after the first 40 bomb- 
sights, the sights of each model are to be numbered consecutively in the 
order of manufacture in each of two series. One series, designated A, 
shall consist of those sights approved without unusual delay by the 
government inspector at the factory on first delivery by the manufacturer. 
The other series, designated B, shall consist of those sights first rejected 
by the government inspector and later approved after defects have been 
remedied, together with any other approved sights whose approval has 
for any reason been delayed. To each sight arc to be affixed both the 
usual serial number representing original order of manufacture and the 
letter A or B, with the nuralier within the A or B series. The subse- 
quent procedures arc to be applied separately to the A and B series for 
each factory and for each model. 

(3) Each series is to be divided into succft.s.sive lots of 20^ strictly in 
the order of original manufacture. 

(4) From each lot of 20, two sights are to be selected by an objective 
chance procedure and sent to the proving ground. No element of per- 
sonal judgment or of rating on inspection should enter into this selection, 
which may be made in the following manner: the procurement authorities 
will send to the chief inspector at the factory a series of opaque sealed 
envelopes marked on tho outside with the first and last serial numbers of 
the successive batches. An envelope is to be opened only after the 
inspection at the factory of all the sights in a batch has been completed 
and report made. Within the envelope will be found two numbers 
between 1 and 20, inclusive, prepared on a strictly chance basis, with 
equal probabilities for all twenty numbers. This must be done through 

■ actual utilization of a chance mechanism or of a table of random num- 
ber.s,* without human discretion other than in the selection of the mech- 
anism. One obvious procedure would be to mark twenty playing cards 
wth the numbers 1 to 20, and after thoroughly shuffling to draw out two 
of them at random. 

(5) The remaining 18 sights of each lot are not to be held at the 
factory until completion of the air testing of the sample but should be 

V 

* For example, PrsnEB and Yates, Statislical Tables, Table XXXIII; Ken- 
dall and Smith, Random Sampling Numbers; Tippett, Random Sampling 
Numbers. 
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sent directly to service, subject to later recall or repair in the unlikely 
event that the sample is found seriously defective. 

(6) Upon arrival at the proving ground, the sample sights are all to 
be shop-tested and adjusted as at present, Avith such further types of shop 
test as may be developed. 

(7) By an objective random procedure like that described in 'Para- 
graph (1) above, lots are to be sheeted for the air testing of the two sights 
representing the lot at the proving ground. It is suggested that one- 
fortieth of the lots produced by each manufacturer be selected by chance. 
(It is likely that this proportion should be reduced as the improved 
methods of shop testing prove their value.) 

(8) Each of the two sights representing each of the lots selected in 
accordance with Paragraph (7) is to be taken up in an airplane tuice to 
be used for dropping bombs. 

(9) The routine flight testing is to be arranged in periods, each con- 
sisting of four consecutive days, or four days as nearly consecutive as 
possible even though there may be breaks on account of Sundays or 
special circumstances. The number of test flights to be made per day 
should first be determined and will here be denoted by k. This same 
number of flights k should be made on each day of the l-dny period, 
though it is not essential that k should be the same for different periods. 

(10) The sights to be tested in a 4-day period are to be the two sample 
sights from each of k lots. Each sight is to be tested on two different 
days of the period, and each lot is to be represented on all four days, 
Subject to these conditions, the assignment of the particular .sight of a 
lot to be tested on a specific day is to he decided by objective chance, for 
example, by flipping a coin. The k lots represented may be^rom the 
same or different factories. They may he of different models and may 
be of A or 2? series or both. 

(11) Exactly four bombs are to be dropped on each flight. Range 
and deflection errors arc to be measured with respect to the heading of the 
airplane at the time the particular bomb w^as dropped. 

(12) The numerical values for control limits and yardsticks given in 
this section are to be used only if the directions in the preceding eleven 
paragraphs arc carried out exactly. If it is decided to revise the plan 
by dropping a different number of bombs on each flight, or by measuring 
range and deflection with respect to the true course instead of the heading, 
the numerical values will need to be amended in accordance with the 
formulas of Sec. 3. The number of bombs dropped per flight will be 
denoted by N, with the understanding in this section that = 4. No 
change should be made except as part of an explicit revision of the plan. 

(13) All measures of quality based on the bombing results should be 
algebraic functions of the coordinates of the bombs with respect to the 
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target, taken with their, proper algebraic signs. Absolute values and 
mean deviations are not algebraic functions and should not be employed 
in this connection. Use of criteria based on mean deviations requires 
‘more bombing to procure comparable accuracy than the formulas used 
her^. Furthermore, in contrast to the T measures here recommended, 
no combination of mean deviations has an exactly known distribution. 

2.2. Control Charts 

2.2.1. General Plan. — Seven control charts, illustrated by Figs. 3.1 to 
3.7,* are to be kept for each factory and model and for the A and B series. 
On these charts certain indicators of quality of successive lots ai e plotted, 
strictly in the order of production. Entries on these charts should bo 
made daily as soon as the data, become available. The charts should be 
posted conspicuously at the proving ground where they will be seen by all 
concerned with the testing. Copies of them should be sent weekly to 
the procurement authorities, to the particular manufacturer concerned, 
and to the government inspector at the factory. The charts should all 
be drawn ■with the same horizontal scale, representing the order of the lot 
represented, and should be placed one above another wth a clear indica- 
tion of the boundaries between them when this is practicable. Space 
should be left at the bottom for comments on exceptional coses and a 
notation of action taken with respect to such cases. 

The quantities represented on the charts, from top to bottom in 
order, will be designated by To, To, Tu, f, Sd, d. The highest of these, 
To, is the most comprehensive measure of the bombing errors associated 
Avith the sights under consideration, and anyone who has time to consider 
only one measure should watch To- The next two break down the over- 
all error into a part representing deviations from the mean point of impact 
(MPI) of the bombs on a flight and a part representing deviations of the 
MPI from the target. All these first three measures are combinations 
of range errors wdth deflection errors. Of the remaining four quantities 
charted, two refer to range errors alone and two to deflection errors alone, 
two to the and two to deviations from the MPI. 

Any general tendency to slipshodness and poor work in a factory is 

* These illustrative charts were made up from the actual hombing data discussed 
in See. 5 and aro thus mutually consistent. Though these records of flights were all 
derived from different sights, they were arbitrarily grouped into consecutive pairs, 
representing fictitious single sights, and these pairs were again grouped into consecu- 
tive pairs representing samples from hypothetical lots, just as if the plan here pre- 
sented had been in effect. The last flight was omitted so as to leave 64 flights, a 
multiple of 4, as is required by this ptlan. The result is to give a reasonably good 
illustration of the kind of charts that can be expected in teat bombing of the kind 
carried out with bombaights of the same general quoUty os the ones then tested. 
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more likely to be observed in rising curves in the upper charts, approach- 
ing and passing the control limits, whereas light on specific faults is to be 
sought by casting the eye downward gradually to the lower charts. 

The seven quantities to be charted will be defined in the following 
paragraphs, beginning with the simplest. They will therefore be in a 
di^erent order from that above. The actual ordinates are not propor- 
tional to the quantities mentioned above, except f and d, but to their 
logarithms. Consequently, aiithlog (that is, semilogarithmic) paper 
should be used for the itop five charts to save the trouble of looking up 
logarithms. Also, the vertical scales on these five top charts are to be 
marked on the left ^\^th numerical values equal to the squares of the T’s 
and s’s since, as will be seen later, this avoids the labor of extracting 
square roots. The T’s and s’s themselves arc given on v’ertical scales at 
the right of these charts. 

We shall use r and d as symbols for range and deflection errors, 
respectively, in mils,* and indicate by S the sum over the iV ( = 4) bombs 
in a flight of the values of the expression following S. 

All the numerical coefficients, yardstick lengths, and control limits 
herein specified should be revised periodically as further experience 
accumulates; they vdW especially need to be revised after any change in 
teclmique has been in effect long enough to provide a sufficient basis in 
experience. Formulas for revision t\ill be found in Sec. 3. 

2.2.2. Control Chart for Mean Range. — ^Thc control chart for f, illus- 
trated by Fig. 3.1, represents = Sr/N for each flight by a cross or a 
circle. For each lot the values of ry found from the two flights of the 
sight produced earlier than the other are represented by circles, while 
those for the sight produced later are represented by crosses. The mean 
of these four values of fy is ft, the mean of the range errors for the lot. 
The points representing ft for successive lots arc connected by straight 
lines. 

Control limits are shown as two pairs of horizontal lines. The prob- 
ability that a lot of sights constituting a random sample from the Same 
population as the sights'tested in the base period, with the same distribu- 
tion of errors of all kinds as in the test period, should be represented by 
a point outside the outer control limits is O.Oi. The probability that such 
a lot should yield a value of f^, falling outside the inner control limits 
under the same conditions is 0.05. The upper and lower limits corre- 
sponding to each probability are at equal distances, not from the zero 
line, but from a line representing the range error in the MPI of all tho 
bombs dropped in the base period. This point is discussed in Sec. 3.2, 
where tlie formulas and numerical values for the control limits are also 

* A mil is an angular measure approximately equal to 1/0,400 of 360 degrees or 
to 1/1,000 of a radian, the exact definition varying from one usage to another. 
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Fig. 3.1- — Cwntrol chart for mean range r. 
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given. The 0.01 limits are represented by solid lines at 5.89 and —3.20 
mils; the 0.05 limits are shown by lines of dashes at 4.80 and —2.11 mils. 

If the zigzag line should get outside the band marked out by the inner 
control limits, this fact may be taken as a warning to be alert for any 
further indication of faults tending to make bombs fall consistently too 
far short of or too far be 3 ’‘ojid the target, as the case may be. If the outer 
control limits should be surpassed, the warning is more emphatic, since 
this will happen only once for 100 lots if there are only the same sources of 
range error as in the base period. An instance of exceeding the outer 
control limits should be made the occasion of an investigation at the 
proving ground to determine the cause. A definite trend upward or 
do-wnward in the plotted quantity is another indication of a dangerous 
condition, even before the inner control limits are reached. In such 
contingencies, unless the trend or the e.xcessive value of fz, is definitely 
attributed to faults of the airplane, personnel, or other cause independent 
of the quality of the sight, the manufacturer should be warned promptly. 
It is particularly important to give early warning of trends in order that 
there may be an opportunity to correct gradually developing faults before 
they become serious. Action to be taken when control limits are passed 
is specified further in Sec. 2.3. 

The control limits refer to fi but serve a secondary purpose also with 
respect to fs, the mean of the range errors for a sight, represented by a 
point that is ordinarily not marked but that can be estimated visually 
from a pair of crosses or of circles. The control limit having probability 
0.01 of being e.xceeded by ft has a probability approximating 0.20 of being 
exceeded by fs, and that having probability 0.05 for fr. has probability 
practically 0.33 for fsi provided the number of bombs dropped in the base 
period is large, say 200 or more. Thus the fluctuations of range error in 
MPI can be followed visually with a fair idea of the relevant probabilities. 

To facilitate further the continuing comparison of means of range 
errors, a yardstick is provided at the left for the difference between the 
means of two lots, a longer yardstick for the difference between the means 
of two sights, and a still longer yardstick for the difference between the 
means of two flights. The vertical distance between points representing 
means of any of these types should exceed the length of the corresponding 
yardstick about once in 20 times if chance alone is operating. The 
means for the sights are not shown but are easily inferred as the centers 
of gravity of the two points representing the flights vdth the individual 
sight. A visual appraisal of the distance between these centers of gravity 
for the two sights representing a lot, in comparison with the middle yard- 
stick, will usually indicate clearly whethej the difference in performance 
in this respect is unusually great. An excessive difference should be 
regarded as a tentative indication, of some variation of conditions at the 
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Fia. 3.2. — Control chart for mean deflection d. 
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factory during the production of the lot , represented by this sample. 
However, it might also be explained by a difference in weathe^'or per- 
sonnel conditions between the two days on which one sight was tested 
and the two days on which the other sight was t^ted ; or by chance alone 
for every twenty such comparisons if these were to be made for all pairs. 
The yardstick lengths on the f chart are 9.47, 6.70, and 4.74 mils for 
flights, sights, and lots, respectively. 

A fallacy that must be guarded against in connection with the yard- 
sticks is a tendency to select the greatest and the least of a series of obser- 
vations and to regard them as significantly different if their heights 
differ by more than the length of the 3 ^ardstick. This is wrong and 
likely to lead to far too many judgments of significant difference, because 
the yardstick lengths are determined on the assumplJon that they will 
be used for comparing only observations selected in .a manner independ- 
ent of their magnitudes. It is perfectly legitimate to use the yardstick 
to compare consecutive observations, or the first and last of a consider- 
able series, though even so it must be remembered that significance will 
emerge fallaciously about once in 20 times. The detection of trends 
in quality should be facilitated by applying the yardsticks to observa- 
tions a considerable distance apart. Discontinuous changes may become 
evident when two consecutive observations differ by an amount approxi- 
mating the length of the yardstick, provided earlier observations are 
fairly well in accord with the first of the pair and later ones with the 
second. It is possible to devise exact statistical criteria for both trends 
and discontinuities, but workers in qualitj' control stress the value of 
graphic devices. 

2.2.3. Control Chart for Mean Deflection. — 'A control chart for 3 
(Fig. 3.2) should be kept in exactly the same way as that for f. How- 
ever, the control limits will be farther apart in the case of the d chart 
and the yardsticks longer because the variance of deflection errors is 
greater than that of range errors. The 0.01 control limits arc at 8.40 
and —2.79 mils; the 0.05 limits are at 7.05 and —1.44 mils. The yard- 
stick lengths are 11.65, 8.24, and 5.83 mils. 

2.2.4. Control Chart for Range Variance. — For each flight the esti- 
mated variance of range errors is defined by the formula 


but may be found with a slight economy of labor by u.sing tiie fact that 
Sir ~ fy = Sr* - f^Sr 

The control chart for range variance is to be on logarithmically ruled 
paper (Fig. 3.3). Values of si for the four flights representing each lot 
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of bombsights are plotted on the same vertical line, two circles for that 
one of the sample sights of the lot produced earlier, and two crosses for 
the other. The arithmetic mean of these four values of s? is the best 
estimate of range variance for this lot of bombsights. The points repre- 
senting such means (which, because of the logarithmic scale, are slightly 
above the centers of-gravity of the points representing individual values 
of 5^) are oormepted by a :;)gzag line. Only a single rontri)! limit is 
plotted in tliis case for each probability considered, since it is not neces- 
sary to be on guard against unusually small variances. When AT = 4, 
the variance estimate for a lot has 12 degrees of freedom (3 for each of 
the 4 flights). The lot variance for range that will be exceeded by 
chance once in 20 times is, according to the estimate supplied by 
our preliminary sample, 82.87, and this is represented by the height of 
the control limit marked 0.05 in Fig. 3.3. The corresponding v’alue for 
probability 0.01 is 104.4 (see See. 3.3.1 for the origin of these values). 

It should particularly be observed that the denominator of each of 
the estimates of variance here used equals the number of degrees of 
freedom, not the sample number. Using the sample number, as is 
often done, introduces unnecessary complications into the determination 
of the probabilities, and if applied in the present case is likely to lead to 
large errors. 

Yardsticks having functions similar to those of Figs, 3.1 and 3.2 arc 
provided at the left of Fig. 3.3. The logarithmic viertical scale of Fig. 
3.3 makes possible the use of these yardsticks, which are to be regarded 
as subject to rigid translation. The e.xact comparison of estimates of 
variance in terms of probability must bo made by means of a function 
of their ratio, or the difference of their logarithms. This is tho reason 
for using a logarithmic chart for In the charts for f and 3, an arith- 
metic scale was \ised, since the comparison between two means must 
be made in terms of their difference, not their ratio. The lengths of 
the yardsticks for flights, sights, and lots correspond, respectively, to 
the variance radios 15.45, 5.82, and 3.28. 

To illustrate the use of these yardsticks, suppose that 5? should 
have the value 10 for one lot and 40 for the next. Both poihts are well 
within the control limits. But the ratio 4 exceeds the yardstick 3.28, 
as is immediately obvious when the points are charted, to such an extent 
that the probability is considerably less than 0.06 of the variances deviat- 
ing so far from equality by chance alone. Unless some explanation 
connected wth the testing is forthcoming, this is to be regarded as a 
danger signal suggesting deterioration of the sights in a manner leading 
to wider scatter in range. The two sights belonging to the lot showing 
the variance 40 should be examined for sources of excessive range vari- 
ance such as loose rate knobs, and any explanation found should be indi- 
cated in the space below the control charts reserved for notes. 
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2.2.6. Control Chart for Deflection Variance. — ^The variance of deflec- 
tion errors is to be treated in exactly the same way, except that the 
control limits are in this ease at 125.4 and 157.9. The yanlstick lengths 
are the same as for the range-error variance chart (see Fig. 3.4). 

2.2.6. Control Charts Combining Range with Deflection. — The indi- 
cators of qualit}' to be used combining range and deflection errors are 
denoted by T with the following subscripts: 

0 for an over-all measure 

M for a measure based only on the mean point of impact (MPI) 

D for a measure based on deviations from the MPI 

A second subscript nil! also be used when needed to make the meaning 
clear, as follows: 

B for an individual bomb 
F for all the bombs dropped in a flight 
S for the bombs dropped with the same sight 
L for the bombs dropped with the sights representing a lot 

It will frequently be convenient to omit the second subscript. 

The definitions of the various T’s all make use of the same coeffi- 
cients a, b, c, whose values may be taken at first, on the basis of the 
experience analyzed in Sec. 5, as follows: 

a = 0.021 724 h = 0.001 331 c « O.OH 360 

However, these values, and the corresponding control-chart limits, should 
be revised periodically as further experience accumulates. They mil 
especially need to be revised after any change in technique of inspection 
has been in effect long enough to provide a sufficient basis in experience. 
Methods of revising them, an^l the f»tbcr numeTieal quaT\titie& used in 
this part, are described in Sec. 3.1.3. 

T% is defined for an individual bomb as 

= ar* H- 2brd + cd^ 

and for a flight, sight, or lot as the sum of the values of for the indi-- 
vidual bombs involved. Howev’er, it will only he in exceptional cases 
that Tob 'vifl actually be computed, and ordinarily it will be convenient 
to computed Tor by the formula 

Tlf = aSr^ + 2bSrd + eSd'^ 

where, as before, S stands for summation over all the bombs dropped on 
the flight. For a sight or a lot the value of 7^ is found by adding together 
its values for the several flights involved. 
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Fio. 3.5. — Control chart for error in mean point of impact Tjr. 
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T\j might be defined for a flight by the formula 
= N{af% -I- 2hrFdp odj) 


but is more easily computed from the equivalent formula 

= afi^Sr + 2hfi'iSd + edrSd 


For a. sight or a Jot the value of T^, Jibe that of T^, is found by adding 
up the values for the flights involved. 

In every case Tq is greater than The difference is defined as 

To- An algebraic identity shows that 


r 2 'Pi 

DF ~ ■‘■OF 

= aS(r — 


rm 

■^ .VF 


fpy -h 2bS(r ~ fF)(d - Jf) + cSid - d^y 


while for a sight or a Jot the value of T% is the sum of those for the flights 
involved. Thus in every case Tl depends only on the deviations from 
the mean points of impact for the respective flights, whereas Th depends 
only on these mean points of impact. 

The direct use of Tu and To will be appropriate only when biases 
such as those disclosed by the statistical analysis of Sec. 5 have cither 
been eliminated or definitely attributed to the bombsight itself rather 
than anything in the testing process. Until such elimination is achieved 
or such a judgment is reached, it is better to modify Tm and To so as to 
make them functions of deviations, not from the target, but from the 
mean point of impact of the bombs of the base period. Indicating this 
correction by placing a caret over T, and using f' and d' for the coordi- 
nates of the mean poiiit of impact of the bombs of the base pei-iod, gives 




_ ag(r - fV -f 26>S(r - f')(d - dQ -f cS((i - d')^ _ T%r + U 






TU - 


A" {a(fp — r'y -f- 2b(rr — r'){dr — 3.') -f- cidf — d')“] 




tIf+u 


where n' is the number of bombs in the base period and 


U = N{af'^ + 2bf'd' -h cd'~) - 2laf'Sr b{f'Sd + d'Sr) -j- cd'5d] 

The numerical values obtained from the 2C0 bombs discussed in Sec. 5 
give, when iV = 4, 

U = 0.64917 - 0.065903iSV - 0.0841295'd 
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For a sight or, a lot, corrected values f% or f\f are found by adding 
together the coTresponding corrected values for the flights involved. 
Values of Ta are not affected by the correction. 

For T\i, ^o» control charts are to be maintained on arithlog 

paper in a similar form to those for s? and ^ (see Figs. 3.5, 3.6, and 3,7). 
However, there is one differeiice in form: The zigzag line on each T 
chart plots the sums of the quantities represented by circles and crosses, 
instead of the means as on the s* charts. This results in all the quantities 
plotted being of kinds customary in statistical theory, and hence easily 
looked up in probability tables, at least to an approximation. A further 
advantage of this arrangement is that it renders the appearance of the T 
charts so unlike that of the .<r charts that they cannot be confused. 

On each of the T charts there is for each of the probabilities 0.05 and 
0.01 an upper but not a lower control limit. The three yardsticks sup- 
plied in each case refer to differences, on a logarithmic scale, of sums for 
flights, sights, and lots, respectively, with probability 0.05. The values 
of for the control limits and yardsticks are given in the follouing 
table: 



n or Tl, 1 

n 

Tjor fl 

0,05 control limit 

16.3 ' 

41.2 

54.4 

0,01 control limit 

21.2 1 

49.4 

64.0 

0.05 yardsticks; 




Flights 

39.0 

5.S 

4.4 

Sights 

9.6 

1 3.3 

, 2.8 

Lots 

4.4 

1 2.3 

1 2.0 


These values require a small correction of a purely mathematical 
kind based on research not j'et completed. 

2.2.7. Illustration of the Use of Control Charts.* — A glance at Fig. 3.1 
shows that all but two of the lots were Avell wthin the control limits for 
range MPI, Lot 9 falls siiglitly outside the 0.05 limit at what may be 
estimated as the 0.04 level. Since there is a reasonably large chance of 
1 out of 15 or 16 caacs exceeding the 0.05 limit, and since lot 9 shows no 
shortcomings on the other charts, this deviation may be disregarded. 

A very different situation is presented by lot 2. As Fig. 3.1 show’s, the 
MPI was in this case an average of nearly 6 mils short, a distance far 
beyond even the 0.01 control limit. Following this lot through the other 
control charts, we observe from Fig. 3.2 that its deflection error in MPl 
was very moderate, and from Fig. 3.4 that the deflection variance wa.s 
exceptionally small. From Fig. 3.3 it appears that the range variance 

• This section is for illustrative purposes only and is based on data put together 
artificially, as explained in the footnote in Sec. 2.2.1 and in Sec. 5. 
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was far below the average. Moreover, in Fig. 3.3 the circles and crosses 
for lot 2 are all remarkably close together, indicating consistently low 
variance, that is, high accuracy in hitting closely around a point 6 mils 
short of the target. Figure 3.5 shows that the range error in MPI is too 
great to he concealed by averaging wnth the small deflection error. Upon 
looking at Fig. 3.6, it is apparent that lot 2 yielded the smallest value of 
Td of all the 16 lots plotted, thus demonstrating a rather remarkable 
accuracy in hitting the wrong point. The error in MPI and the close 
clustering about it offset each other sufficiently so that the bombs of lot 2 
are only moderately far from the target in terms of To, so that Fig. 3.7 
shows nothing remarkable. 

This combination of peculiarities might be brought about by a 
bombardier \\’ith very quick reactions, enabling him to keep the airplane 
on a remarkably good course and to maintain regularity in his behavior, 
but causing him to release the bomb consistently too soon. Such a man 
shoul(^ be capable of development into an exceptionally accurate bombar- 
dier if he studied the control charts and particularly his own errors. 

2.3, Action When Results Are Bad 

If in any case the rigzag line crosses its 1 percent control limit, an 
investigation should be made of the cause of this anomaly, and the 
probable cause entered in the space provided for the purpose at the 
bottom of the control chart. If the investigation includes further air 
testing following shop adjustment, the same seven quantities should be 
computed for the new air tests and their significance judged by means of 
the probability formulas of Sec. 3. Entries of probable cause should 
indicate clearly whether the e.vcessivc bombing errors bringing about the 
anomaly are believed to indicate a fault in the sight or in some feature 
of the testing process. Pure chance may be blamed approximately once 
for every hundred lots from which sample sights are tested ; this allotment 
of 1 anomaly in 100 applies separately to each of the control charts. 

Some clues as to the nature of the trouble will be provided by an 
intelligent reading of the control chart itself, with attention to the con- 
sistency of performance of tlie two sights in a lot and of the two flights 
mth each eight, and observing whether the trouble is in range or deflec- 
tion, or both, and whether it introduces a bias into the MPI or increases 
the dispersion about the MPI. To facilitate such inquiries, a list of the 
types of defect likely to lead to excessive deviations in each of the seven 
control-chart quantities may be used (see that below, p. 140). 

Tf the 0.01 control limits are exceeded repeatedly, the investigation 
should be extended to the factory. Intensified shop inspection should 
also be applied. In extreme cases the remaining sights in a lot repre- 
sented by defective sights should be recalletJ or repaired. If this happens, 
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the shipment of further sights prior to completion of air testing of samples 
should be suspended until the factory has again established a satisfactory 
record; and the factory should revert to the status of a new factory, which 
implies that 40 consecutive sights should successfully pass the air test. 
Exact criteria as to when this should be done will need to be formulated in 
the future on the basis of further experience. 

When the rate of production of bombsights is to be reduced, the 
average showing of a factory on the control charts should be taken into 
consideration, in comparison with that of other factories. The average 
value of is probably the best criterion that can be draivn from the 
coordinates of the bombs dropped in air testing for deciding which factory 
should be eliminated. 

The control chart should not, however, be looked upon primarily with 
a view to drastic action. Its great value, demonstrated in other indus- 
tries, is in detecting trends in quality and calling attention to deteriora- 
tion while it is still incipient anil before it becomes serious. When this 
value is recognized, the attitude of manufacturers changes from hostility 
to appreciation. In order that these desirable results be realized, it is 
essential that copies of control charts be transmitted promptly to manu- 
facturers, and that attention be called to iwculiaritics revealed by them. 
Such peculiarities include not only the crossings of the 0.01 limit that call 
for investigations or more serious action, but also cases of exceeding 
the 0.05 limit more than about once in 20 times, or of progressive 
drifting up toward the control limits, or of excessive variation between the 
performances of the same sight or of two sights from the same lot, as 
indicated by the yardsticks. The meaning of each of the seven control- 
chart indicators should be made clear to all concerned. 

The yardsticks are designed to facilitate visual discernment of tenden- 
cies to drift before the control limits are reached and also to help in. 
observing abrupt changes. A little practice and familiarity with this 
type of chart should make it possible to detect such changes more 
promptly than would otherwise be easy. Prompt detection of trends 
and anomalous tendencies can be of great value if the factory is notified 
at once, since trouble can often be found and corrected in this way before 
it becomes serious. It is to the interest of the government and the 
manufacturer alike to prevent serious trouble by early corrective action 
of this sort, rather than to wait for it to develop to the point at which 
bombsights will be rejected. 

Of all the indicators, To is the one likely to give the sharpest dis- 
crimination between cases in which sights are really defective or the 
bombing for any reason poor, and on. the other hand cases of pure bad 
luck. It combines the evidence from all the others and can serve as the 
deciding agent in marginal cases in which the others seem to disagree on 
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the question whether the bombing was good or bad. In a more spe- 
cialized way, Tu combines the evidence of f and d, while To combines 
that of Sr and Sd- It is for diagnosis of the trouble rather than for evi- 
dence of its existence that the main reliance should be placed on the charts 
for means and variances. 

Investigations .prompted by excessive control-chart deviations will 
be assisted by a list of possible causes under each of the seven control- 
chart measures. Such a list is l>est drawn up by persons in continuing 
close relation to the manufacture, testing, and use of the sights and may 
need modifications from time to time with changes of model and in the 
testing procedure. The list below i.s purely tentative and needs to be- 
supplemented by further suggestions drawn from personnel concerned 
with manufacture, shop testing, air testing, and maintenance. 

In order that such suggestions be made intelligently, it is necessary 
that the personnel involved have eoroc general understanding of the 
meaning of each of the seven measures. The following definitions may 
be sufficient for most of those concerned: 

f Range coordinate of mean point of impact 
5 Deflection coordinate of mean point of impact 
St a measure of dispersion in range 
Sd A measure of di5i>ei'sion in deflection 

Tif A measure of distance from mean point of impact to target, 
modified in accordance with probability principles to allow for 
the greater deflection variance 

Td a measure of dispersion about the MPI combining range and 
deflection errors 

To An over-all measure of errors of all kinds 

It should be understood that each of the T measures combines range 
with deflection errors, and that To combines all the other measures into 
one. If a particular defect in a sight, or in the testing process, can affect 
only range errors it is more likely to Iw detected through f or than 
through any of the measures that include deflection errors. In the same 
way, if a particular defect can affect only deflection errors, it is more 
likely to be found from the d or Sd chart than from any of the T charts. 
HoAvever, any defect that causes both range and deflection errors may 
sometimes be detected through one of the combined T measures when it 
would be impossible to distinguish it from mere chance on the basis of 
the charts of range 'or deflection errors alone. Similarly, any cause 
affecting both MPI and variance can sometimes be brought out clearly 
by To when none of the others would make it definite. 

In making up such a list, it appears better to consider the various 
possible sources of trouble and mark each with one or more of the seven 
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symbols, later rearranging to get lists in the form below, than to begin 
^\^th the seven control-chart measures and try to think of all the possible 
causes. 

The following partial and tentative list should be understood in the 
terms of the preceding remarks. Under each control-chart measure arc 
listed several causes, any one of which might lead to an excessive value 
for the measure. Each factor is listed only under the measure or meas- 
ures most likely to lead to its detection, though it may also have minor 
effects on other measures and wall' be reflected in more comprehensive 
measures. 


f 

Grease on disk 
Worn disk 
Faulty trail plate 
UolefljsR Tnechaniam slow or fast, 
Bombardjer’a reaction slow or fast 
Loose teloscopo cable 
Faulty sight gyro 
Wrong disk speed 
Louse altitude kuob 
Slipping of scale on altitude drum 
Faulty or wrongly adjusted telescope 
drive governor 

<1 

Faulty directional gyro 
Stabilised sector off center 
Pilot director scale displaced 
Pilot director rheostat inaccurate 
Pilot director brush worn 
Crosstrail mechanism inaccurate 

Sr 

Erratic release luechanisni 

Erratic behavior of bombardier 

Grease on disk 

Roller or disk not smootli 

Roller not accurately centered 

Loose telescope cable 

Ix^ose range knobs 

Loose altitude knob 

Faulty sight g>'ro 

Faulty telescope drive motor 


Sd 

Loose course knobs 
Faulty directional gyro 
Stabilized sector off center 
Slow reaction by airplane 
Slow reaction by pilot 

Any combination of factors affecting 
f and d 
Wrong altitude 
Wrong air speed 

Faulty direction of optical axis of teJo- 
scope 

Sight gyro inaccurately leveled, perhaps 
because of inaccurate bubbles 

Tr. 

Any combination of factors affecting 
Sr and 

Loose altitude knob 
Sticky bearings 
Variable winds 
Poor visibility 
Bumpy air 

To 

Any combination of factors affecting two 
or more of the other measures 
General stipshodness or lack of skill in 
either manufacture or testing 
Variable winds 
Faulty sight gyro 


2.4. Experimeatation 

This plan may readily be adapted for efficient combination with 
c.xperiments for determining the relative excellence of different models 
of sights and types of bombing, or for investigating other questions relat- 
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ing to bombing. Considerable economy in the total amount of bombing 
required should be obtainable by a proper design for e.xperimenting 
simultaneously on various types of equipment and technique while at 
the same time carrying out the routine test bombing ^vith full accuracy. 
The amount of bombing required will be greater than for the routine 
testing alone or for the experiment alone, but less than the sum of the 
two. 

To ensure valid results from such combined enterprises, it is important 
to verify before the experiment is carried out that it satisfies the criteria 
of the modem statistical theory of design of experiments. It may be 
difficult or impossible to salvage any useful information from the results 
of an improperly designed experiment. Many designs are possible for 
efficient combined experiments. The selection of a particular design is 
best made in relation to the objects of a particular experiment. 

As an illustration of a simple type of combination of experiiht'nt 
with routine testing, suppose that some new type of auxiliary equipment 
is to be examined (1) for its effect on the range component f of mean point 
of impact, (2) as to its effect on the standard deviation «, in range, and 
(3) as to its effect on general accuracy. Instead of tw'o flights per sight, 
four flights might now be made for a time with each sight. Two of 
these flights are to be on one day of a 4-day period and two on another. 
Of the two flights with a sight on the same day, one, chosen by tossing a 
coin, is to carry the new equipment and the other is not. A valid analysis 
of variance of range can bo carried out from the results to answer 
question (1), and analogous procedures to answer (2) and (3) by means 
of and To, respectively, though the analysis for To must either involve 
approximations or wait for mathematical research on the subject to 
progress a little further than the point heretofore reached. The accuracy 
of determination of the differences made by the new equipment Avill be 
fully as great as if the entire enterprise were devoted wholly to this 
question. From this standpoint the information relevant to the routine 
testing program is obtained free of charge. 

For the rating of men and equipment routinely employed in the 
testing of bombsights, it is possible to utilize the results ^rithout any 
modification of design other than objective randomization in the assign- 
ments of the various flights. This randomization should be restricted 
by conditions of balance and orthogonality in order to have the most 
accurate ratings possible and to simplify calculations, but these condi- 
tions are not essential. One simple type of rating would be merely the 
average of the values of Tl for the flights involved. However, the use 
of new types of equipment or personnel not used in the base period from 
which the control limits were determined will invalidate these control 
limits and should not be introduced into the air testing of bombsights 
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without a suitable modification of design. Similarly, altitude and other 
conditions attending the test bombing should be kept as nearly as possible 
the same as in the base period until a deliberate decision is reached that a 
change should be made and maintained ov'er a considerable period. In 
such an event, it will be neccssaiy to begin over again the process of 
accumulating data for no\v control-chart limits. 

3. FORMULAS AND CONSIDERATIONS AFFECTING REVISIONS OF 

THE PLAN 

3.1. General Considerations 

3.1.1. Occasions for Revision. — New information and changing condi- 
tions vriW from time to time call for revisions of the sampling plan specified 
in Sec. 2. Among the changes likely to be appropriate are alterations 
in the size of lots, the proportion of a lot that is to be air-tested, the number 
of flights uith each sight, the number of bombs dropped per flight, and 
the estimates of the variances and covariances of range and deflection 
errors from which control limits and yardsticks arc calculated. 

Another kind of change that may be developed is the use of improved 
types of control charts for shop inspection, together witli the integration 
of shop-inspection procedures uith air testing in a more systematic way. 
For such improvements the same statistical methods that arc here 
recommended for air testing may be applied to shop testing, or to a 
combination of shop and air testing. Such a development would mean 
that instead of the two types of measurement, range and deflection 
errors, it would be necessary to take account of a larger number of 
measures on each sight and to make appropri.ate combinations of the 
various measures. The mathematical methods of multivariate statistical 
analysis are capable of extension with a little research to much more 
general situations involving coordinated testing at different stages. 
For this reason, and for the sake of other analogous applications, certain 
formulas will attain greater generality by being w'ritten in a form suitable 
for ready extension to more than two variable. Consequently, x* and Xi 
will sometimes be used instead of r and d for range and deflection errors, 
and subscripts will be used which take only the values 1 and 2 in the 
present chapter but which may be understood to take other values as well 
in cases in which more measurements are made. For example, in place 
of the a, h, and c introduced in Sec. 2.2.6, when generality is sought In, 
and liz, respectively, will be used, so that such a formula as 

7 ’a = „r“ + 2brd + cd= 

may also be written 

= luXl -f- 2I12X1X2 + ^ 223=2 

or, more compactly, 

= Z2li,XiXi 
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with the understanding that the first 2 stands for summation with respect 
to i and the second 2 \vilh respect to j. In this chapter, the summations 
will be over the values 1 and 2 only, but in the extensions envisaged 
they may be over any set of values. Our results will be in such forms as 
to be readily extended to the more general cases. 

Still another type of revision of this and other sampling plans is 
likely to be required for sequential analysis, by which the decision as to 
the number of tests to be made is not fixed at the beginning of the testing 
but is postponed and determined by the gradually accumulating data. 
Considerable economies are possible by use of a well-worked-out system 
of sequential testing. Mcthofls of applying sequential analysis to the 
particular problem of this chapter have not yet been developed.* 

3.1.2. Numbers of Sights, Flights, and Bombs. — In the plan suggested 
in Sec. 2, the proportion of sights to be sent to the proving ground was 
taken as onc-tenth simply because this hxs been the proportion sent in the 
past and because the shop-testing facilities appear to be adequate for 
dealing with this proportion. A continuing rating of the inspection at the 
factories in comparison with the results of the shop and air tests at the 
proving ground, and a consideration of the nec<ls of the service, might lead 
to the decision to send either a larger or a smaller proportion of sights to 
the proving ground. If it should be decided to increase the proportion of 
sights sent'to 15 or 20 percent of the total, this could be accomplished by 
sending 3 or 4 sights from each lot of 20 with a minimum of disturbance of 
the sampling plan. If, on the other hand, it should be decided that the 
inspection at the factory is more adequate than has been felt to he the case 
in the past, and a smaller proportion of sights is to be sent, the best way 
to do this would be to increase the size of the lot. It is desirable to 
have the lot large enough so that, with the proportion adopted, at least 
two sights chosen at random from each lot shall be sent to the proving 
ground. The reason for this Is that there should be available a con- 
tinuing measure of variation within lots, and this requires at least two 
sights from each lot. Such variation is displayed by the control-chart 
scheme of Sec. 2 along with the jneasure.s of average quality. 

If the number of sights taken from each lot should become larger, 
measures of this intra-lot variation could be calculated easily and accu- 
rately, but the graphic portrayal by circles and crosses might not be so 
clear, and vertical segments proportional to calculated measures of 
variation might need to be used instead. If collateral experimentation 
on methods of bombing, auxiliary equipment, and so forth, is to be com- 
bined efficiently with test bombing, there is an advantage in having more 

• See Chap. 17 for a brief account of sequential analysis. For fuller accounts see, 
on applications, Statistical Research Group, Sequential Ajuilysis, and on theory, Wald, 
“Sequential Tests." 



144 


TECHNIQUES OF STATISTICAL ANALYSIS 


Chap. 3 


than two sights chosen at random from each lot, as the larger numbers 
make possible the design of more efficient experiments. Against this 
consideration is to be set the fact that if the lots are large, as would be 
implied by having a large sample constituting a fixed percentage of a lot, 
there might be an excessive delay at the factory in the accumulation of 
enough sights to make a lot so that the random-sampling process could 
be applied. This objection to large lots would apply particularly where 
the rate of production of a factory is rather small. This matter is 
touched upon further in Sec. 4.2. Tlic proportion of sights received at 
the proving ground to be air-te.sted has been arrived at not by calcula- 
tion but somewhat arbitrarily from a general survey of the practices 
prevailing in the past and the opinions of those most closely in touch 
with various phases of the situation. 

It is essential that at least two flights bo made with each sight in 
order that a measure of variation due to the weather and chance factors 
may be available. The number of bombs dropped per flight has been 
taken to be four, because that was the most commonly used number in the 
period just before this study was begun. However, since six ore-Hlled 
test bombs can be dropped on a flight and since additional accuracy is 
gained by this practice, it may prove desirable to modify the plan to 
fit tliis or some other number N of bombs dropped on a flight. Increased 
accuracy can also be obtained by increasing the number of flights per 
sight. In the light of data accumulating under tho sampling plan, the 
question of what combination of ntimber? of flights per sight and of 
bombs per flight gives the most economical method of obtaining the 
requisite accuracy needs to be investigated from time to time; or (what 
is somewhat the same thing) what combination gives the maximum 
accuracy obtainable witli the resources available. Such a combination 
can only be arrived at by a study of comparative costs in conjunction 
Avith tho relation of variance between flights to variance between bombs 
on the same flight. 

3.1.3. Revision Based on New Experience. — Revision of the variances 
and covariance of range and deflection errors may need to be made 
because of changes in techniques of bombing; it should eventually be 
made anyhow in order to have more accurate estimates of these param- 
eters than arc at present available. From a long scries of reasonably 
homogeneous control-chart data, the variance of range s? may be esti- 
mated as the mean of s? for the recorded flights, and the variance of 
deflection si similarly. There is a need also for an estimate, which Ave 
denote by Sfd, of the covariance of range and deflection errors. For a 
single flight Avith N bombs such an estimate would be 

S(r - f)(d - d) Srd ~ rSd 
N -1 ~ N - 1 
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but the average of these estimates over the long series should be adopted. 
(If N varies among the flights, the ratio of the sum of the numerators to 
the sum of the denominators should be used.) It is not necessary 
actually to compute these sums of products if all the calculations going 
into the control chart have l)een correct and are available, since the 
products have already been computed in the process of obtaining values 
of T®. Indeed (Sec. 2.2.6), 

T%^ = aS{r - fp)2 + 2bS(r - f^)(d - dy) + cS(d - d^y 

If we sum for m flights, each with N bombs, and use the expressions for s\ 
and we may solve and obtain as our new estimate of covariance 

- as? - cs^ 

The number of degrees of frewlom dcrivetl from each flight is iV — 1, and^ 
therefore from the m flights iti the sample it is in{N — 1). We shall put 
n *= miN — 1). This important number, which must be used in the 
determination of control limits, j^arrlstick lengths, and various tests of 
statistical significance, should be recorded carefully. 

The revised values of the coefficients for T‘‘- arc 

n - r _ _ sj 

sjsl - - s®, 

The nature of these formulas will perhaps be clearer by reference to a more 
general case. If, instead of range and deflection errors, wc were meas- 
uring a considerable number of features of each sight and combining 
these into one over-all indicator, we should use for the last formula 
on p. 142, with each coefficient k, equal to the cofactor of the covariance 
between the fth and jth measures in the determinant of such covariances, 
divided by this determinant. In the formulas for a, b, and c above, the 
common denominator is the covariance determinant, T\'hile the numer- 
ators are the cofactors of the elements of this determinant.* 

After two or three years of test bombing in a fairly uniform manner, 
it should be possible to obtain useful measures of seasonal variation to 
be applied as corrections. Even without this delay, it may be possible 
by a special statistical study to work out corrections of the variances to 
allow for the weather. The effect of any such corrections upon the 
number n of degrees of freedom should be noted. 

“ The reader unfamiliar with determinants con readily learn enough about them to 
carry out these instructions from the chapter on determinants in any book on college 
algebra, or from Chap, VII, “Determinants,” in Crum and Schumpeter, Rudimentary 
Mathematica. In the determinant of the covariances the elements corresponding 
■with i = j arc simply variances; thus »« = «*. 
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3.1.4. Assumptions Involved. — ^The control limits on the charts sup- 
ply a test of the hypothesis that the s^hta of a particular lot are as good 
as the sights used in the base period. The limits are so determined that, 
if the hypothesis is true, the 0.05 limit will in the long run be exceeded 
approximately once for every 20 lots, and the 0.01 limit approxi- 
mately once for every 100 lots. The functions plotted on the control 
charts have been chosen in accordance with the findings of statistical 
theory as those most likely to lead to these limits being exceeded if the 
sights tested are in fact worse than those of the base period. 

These statements are, to be sure, based on a number of assumptions, 
hut the assumptions appear reasonable. It is assumed that the diffeient 
bomb drops are statistically independent or that corrections are applied 
that take care of any lack of independence. If the randomization proce- 
dure prescribed in Sec. 2 is followed, and especially if suitable corrections 
are made for weather, this assumption should fit the facts closely as 
regards test bombing done under tho plan. Whether true independence 
can be ascribed to the actual bombings used in calculating tire initial 
control limits may be questioned, since no scheme of objective randomiza- 
tion was in effect at the time and since no corrections wore made for 
weather apart from the selective effect of there being no bombing in the 
worst weather. It is the writer’s impression, based on inspection of the 
procedures and records, that lack of independence in these bombings is 
not such as to make any great difference in the control limits. The 
weather factor may be more serious, since the test bombings of this base 
period were all made in November and December. However, the charts 
kept at the proving ground of earlier bombings under different conditions 
failed to disclose any obvious evidence of any marked seasonal variation 
in results. 

It is assumed that the bombing errors in range and deflection have 
a bivariate normal distribution. This assumption has a certain a priori 
justification in the notion of the errors resulting from accumulation of a 
large number of independent errors and has also an approximate a 
posteriori verification in various records of bombing. There is, to be sure, 
a slight skewness in range errors, which can be explained by a small 
proportion of bombs having defects that cause them to fall short with a 
bias peculiar to thus small group. Ilow'cver, the deviations from nor- 
mality appear to be so small as to have no appreciable influence on the 
final results, so far as can be judged from general statistical considera- 
tions. Certainly there is no similarity between the recorded curves of 
bomb distribution and the sharp-peaked theoretical ones for which 
mean deviations provide efficient measures of dispersion. 

No assumption is made in this chapter either that correlation of range 
with deflection errors exists or that it does not. The records used in 
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Sec. 5 indicate that little or no correlation exists, though other records 
consisting of compilations of huge quantities of heterogeneous material 
do superficially indicate high correlations. The high correlations in 
these eases can probably be ascribed to the mixing of records of bombings 
at many different places and times, with various kinds of equipment, with 
personnel of widely different degrees of skill, together with faulty records 
whose complete compilation proved impo^ible. Even if there were a 
substantial correlation, it is not clear that tliis would be a serious detri- 
ment if the variances of the errors were moderate. The use of in the 
plan is equally valid whether correlation e.xists or not. 

In selecting the T functions, it is assumed that no bias in any special 
direction is to be guarded against, but that equal precautions are to 
be taken against biases in all directions. Proofs of the optimum proper- 
ties of T have been given by Hsu and by Wald.* 

It is assumed also that exact probabilities are to be represented 
by the control limits, free from approximations of unkno^vn degrees of 
accuracy. This consideration eliminates some plausible functions, such 
as the mean, or mean square, of the actual distances of the bombs from 
the target. WTiilc these functions have an intuitive appeal and seem 
at first glance to represent the real value of the bombsight because 
closeness of bomb to target is the criterion of ofTectiveness in action, they 
are not suitable for use proof bombing. They are inefficient 

even for large samples by comparison with T%, and for small samples 
they suffer from the impossibility of determining exact probabilities 
reJatb’e to them (see Sec. 4.8). 

3.2. Means 

3.2.1. Control Limits for Means. — -The outer control limits for the f 
chart are so chosen that, if the distribution of range errors is the same as 
in the base period, the probability is 0.0 1 that the mean f of the range 
errors found wth the sights of any particular lot should be represented by 
a point falling outside these limits. The inner control limits are deter- 
mined in the same way except that the probability is 0.05. The 
heights of these lines in terms of the scale of mils on the chart are given 
by the formula 

in which the following notation is used: 

f' = mean of range errors in base period. (Errors "over” are con- 
sidered as positive, errors "short” as negative.) 
s' = estimated standard deviation of range errors in base period, 
• Hsu, “Generalized T”\ Wald, “Tests Concerning Several Parameters.” 
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corisistinR of the square root of the ratio of a sum of squares 
with n degrees of freedom to n 

n' = number of range errors averaged in base period to obtain f' 

N ~ number of bombs dropped per flight in the period for which 
the control chart is to be used 

g = number of flights per sight in the period for which tlie control 
chart is used 

)i — number of sights per lot in the period for which tiie control 
chart is used 

e = 0.01 for outer control limits, 0.05 for inner limits 

/, = value of ratio of deviation in a mean to its estimated standard 
error (with n degrees of freedom) exceeded in absolute value with 
probability e 

With the additional notation 


d' — mean of deflection errors in base period (errors to the right 
considered positive, to the left as negative) 
si = estimated standard deviation of deflection errors in l)aKo period 

we have the parallel formula for control limits for 5^ 

The base period considered in See. 5 yields tlie following numerical 
values : 

f' = 1.3450 mils d' = 2.8040 mils 

si = 6.8040 mils si = S.308C mils 

n' = 200 n = 256 


According to the specifications in Sec. 2.1, g = h = 2 and N — A. Values 
of U can be found in tables of the Student distribution.* However, 
these tables do not extend to the value n — 256. For such large values 
{» may be obtamed as the first two or three terras of the asymptotic 


series 


+ 1 . (x= + 3)(5x2 + 1) 
4n 96n- 




where x is the unit normal deviate exceeded in absolute value with 
probability e.f We thus find forn = 256 

* See Fisher and Yates, Siali&Lical Tables, Table III. This shows t* to 3 decimal 
places for e = 0.001, 0.01 , 0.02, 0.05, and 0.1 to 0.9 by steps of 0. 1 , for rt = 1 to 30 by 
steps of 1, 40, 60, 120, and ». Also, see Mebrington, “Percentage Points of the 
f-Distribution.” This shows f, to 5 significant figures for « =* 0.005, 0.01, 0.025, 
0.05, 0 10, 0.25, and 0.50, for the same values of nuaetl by Fisber and Yates. 

t Values of x may be found from Table 1.1 in Chap. 1, provided «/2 is used in 
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io.oi = 2.59514 (o.ob = 1.9^925 

Substituting these values gives control limits for Tl as follows: 

0.01 limits; 1.3450 ± 4.5481 = 5.8931 and -3.2031 

0.05 limits: 1.3450 + 3.4512 = 4.7962 and -2.1062 

For dt, in the same^ "-'e find 

0.01 limits: 2.8046 + 5.5940 - 8.3986 and -2.7894 

0.05 limits: 2.8046 ± 4.2448 = 7.0494 and - 1.4402 

3.2.2. Asymmetry of Control Limits and Bias in Base Period. — It may 
seeui strange tliat the coiititjJ limits are not symmetrical Avith respect 
to the zero line on the f and d charts, since sights whose use gives moan 
points of impact close to the target seem more desirable than those 
yielding more remote ^MPI’s. A like question arises in connection with 
Tis and To. However, it should be emphasized that our comparisons 
arc not ^\*ith a theoretical ideal but with the actual performance of a 
base period in which the testing procedure is presumed to bo comparable 
\rith that in the period for which the control chart is to be used. The 
material on which our records are based shows biases in both range and 
deflection errors in e.xcess of any that could reasonably be ascribed to 
chance. Whether these biases resided in the sights, in the habits of the 
test bombardiers or pilots, in some other feature of the test bombing, 
or in the observation of the results we do not know. The sights used 
were accepted. If the bias was the fault of the sights, this fact should 
be ascertained by an ad hoc inquiry and the manufacturing design changed 
accordingly. If the bias was a result of something in the test bombing 
other than the sights, and if this condition continues in the period for 
which the control charts arc to be used, it is necessary that the control 
limits be asymmetrical ndth respect to the zero line in order to avoid 
wholesale fal.se alarms regarding sights that are really quite .satisfactory 
but with which the test bombs fall moderately farther over and to the 
right than the average. If the proof-bombing procedure is such as to 
create the observed bias, a sight should bo labeled unsatisfactory much 
more readily for bomb errors to the left and short than for errors of the 
same maprnitude in the direction in which the bomb errors are usually 
made. Use of the asymmetrical limits is equivalent to applying a 
correction to each bomb coordinate to compensate for the bias observed in 
the base period. 

entering the table. The value of x for e = 0.01 is 2.57582930, and for f = 0.05 it is 
1.95996398. 

The series for i, in terms of x ia cquiv'alcnt to a series for x in terms of f, given by 
Hotelling and Frankel, “Transformation of Statistics," and by Goldberg and Levine, 
‘*t and X*”; the first two terms are also given by Peiser, “Significance Levels.” 
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If a change in bombing procedures, or in methods of observ’ing the 
positions at which the bomba fall, results in elimination or alteration of 
the observed bias, the control limits should be changed accordingly. 
Until this is done they should be based on experience. 

If an investigation leads to the conclusion that freedom from bias 
has been achieved in the test bombing and is likely to continue, the control 
limits for f and d should be symmetrical about zero, at the same distances 
as from the central lines previously indicated. At. the same time, Tm 
should be replaced by 2 «, and /© by u both as to calculated values and 
in the labeling of the control chart. 

Other considerations involving the fallibility of the base-period sample 
arise in connection ^^*ith the effect on the distance bet^v■ccn upper and 
lower control limits of the number of bcimbs in the base period. The 
reciprocal of this number n' is one of the terms under the radical sign in 
the formulas for the control limits, so that if the control limits are based 
on a period in which very few bombs were dropped, the limits \vill be 
relatively far apart. In such a period U "'ill also be slightly larger than 
if numerous bombs were dropped and "ill push the control limits 
still farther apart. This fact is a consequence of our ability to make 
clear comparisons only with past obseiwations. If the preliminary 
sample with which we compare a new sample is small, the possibility of 
establishing a difference when one really exists is diminished. 

The effect of n' on the control limits is rather slight for numbers of 
any such orders of magnitude as we have been considering. There 
seems no reason here why the control limits should not be revised after 
every 200 or 300 b(jmbs, if it is thought that fundamental conditions 
have changed in such an interval. A more serious objection to such 
frequent revision for the present is the lack of exact probabilities when n 
is small. 

3.2.3. Yardsticks for Differences of Means. — Unlike the control 
limits, these yanlsticks are unaffected by the bias in the MPI's of the base 
period. The lengths of the yardsticks for means of flights, sights, and 
lots are, respectively, 



where s' is to be replaced by for the range yardsticks and by for the 
deflection yardsticks, and the value of <o.o 6 is to be determined with 
reference to the value of n underlying the estimates of variance in the 
base period. For <7 = h = 2, .N = 4, and the same values of s' and s'^ 
used previously on the basis of experience, these expressions take the 
following values, which are the lengths of the yardsticks shown in Figs. 
3.1 and 3.2: 
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Flights 

Sights 

IjOts 


0-4741 ^ 

6.6992 

4.7370 


11.6.527 

8 2397 ' 

.'>.8203 



3.3. Variances 

3.3.1. Control Limits for Variances. — ^The control limits on the charts 
for s* and s3 are fixed in accordance with the distribution of the ratio cf 
two independent estimates of the same variance. This ratio is usually 
denoted by F, since R,. A. Fisher was the first to work with the distribu- 
tion and to show its extensive usefulness in statistical work of many 
kinds.* 

To obtain the 0.01 control limit for si, we put = F, and obtain 
from the table of 1 percent points the value of F corresponding to 

~ ~ 1) rtz ^ n 

From this value of F and the’value found from the base period we 
obtain s*, the upper control limit. According to the plan specified in Sec. 
2.1, ^ = k = 2 and iV = 4, so that ni = 12. For the base period of 
Sec. 5, n = 256 and = 40.295. From the tables it is found that, for 
Hi = 12 and = 250, the 1 percent point of F is approximately 2.2544. 
Multiplying this by 40.295 gives the value 104.4 as the 1 percent control 
limit for s?. 

The numerical values for the control limits on the s^ scale of Figs. 
3.3 and 3.4 are found in this way and given below: 



0.01 limit 

0,05 limit 

Range 

104.4 

82.9 

Deflection 

i 

157.9 

125.4 


These control limits take full account of the fact that the variances 
derived from the preliminary sample are not exactly those of the popula- 
tion but are based on 256 degrees of freedom instead of an infinite number. 
If the same variance estimates had been obtained from a preliminary 
sample of> say, 1,000,000 degrees of freedom, the control limits for range 
variance would have been reduced to 101.2 and 81.1, with proportionate 
reductions in tbe case of deflection. 

* For a table of F, see Fisher aud Yates, Slalistical Tables, Table V, where F is 
Called “the variance ratio.” This table contains a footnote which, since it may be 
misinterpreted, should be disregarded in following the instructions in this chapter. 
A more extensive table of F is given by Merrington and Thompson, “Percentage 
Points of the Inverted Beta (F) Distribution.” 
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3.3.2. Yardsticks for Variances. — yardsticks on the variance 
charts have no i-elation whatever to the base' period hut depend only on 
the numbers of degrees of freedom in the current variance estimates 
that arc to be compared. Their lengths are the same for the charts of 
range variance and of deflection variance. The vertical distance between 
two plotted points has probability 0.05 of exceeding the length of the 
appropriate yardstick if the variances plotted arc obtained from samples 
from the same hypothetical infinite population. If F is the ratio of two 
such sample variances nith equal numbers of degrees of freedom, log F 
has a symmetrical distribution extending from minus to plus infinity. 
The value of log F corresponding to the length of the yardstick is such 
that its probability of being exceeded in absolute value is 0.05. Hence, 
the probability of a random value being actually greater than this is 
0.025, and the probability of its being less than the negative of this yard- 
stick value is also 0.025. The yardstick length would thus correspond 
to the 23^ percent point of i\ieF distribution.* 

For each flight the number of degrees of freedom for the differences 
among the range coordinates of the N bombs is JV — 1 ; this is equal to 
the number of degrees of freedom of tho deviations of these N numbers 
from their mean, The variance estimates for sights and for flights arc 
obtained by adding the sums of squares of deviations from the respective 
flight means and dividing by the sum of the numbers of degrees of 
freedom. Thus the number of degrees of freedom in the variance esti- 
mate for a sight is giN — 1), while for a lot it is gh(N — 1). 

For the specilved values g * h = 2, i'f * 4 the numbers of degrees 
of freedom fur flights, sights, and lots, respectively, are therefore 3, 6, 
and 12. '^I'he critical values of F in these three cases are 15.439, 5.8i97, 
and 3.2773. On the logarithmic scale of s- at the left of Fig. 3.3 the 
lieights from 1 to these three numbers are the lengths of the yardsticks. 
On Fig. 3.4 the lengths arc the same. 

3.4. Comprehensive Measures 

3.4.1. Control Limits for the T^s . — When the variance estimates for 
the base period utilize a large number n of degrees of freedom, such as 
the value 25G here used, the distribution of T* is approximately the same 
as the x‘ distribution that has been tabulated and widely used lor a 
variety of statistical purposes.! This distribution depends on a number 
of degrees of freedom /, which may be defined in the following manner. 
For each bomb the measure of discrepancy from the target 

• The 2^ percent points of F are not given by Fisher and Yates but are given by 
Merrington and Thompson. 

t For tables of the x* distribution, see Fisher and Yatoa, Stalislical Tables, Table 
IV ; or Thompson, “Percentage Points of tho x* Distribution.” 
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Tob = + 2brd + cd‘ 

has (approximately for largo n) the x* <listribution with 2 degrees of 
freedom, provided the bomb is dropj)e<.l under essentially the same condi- 
tions as the bombs in the base period, and proVided the probability dis- 
tribution is actually centered at the tai^ot wthoiit bias. The sum of 
any number of independent va.liies of x* has the x^ distribution with a 
number fd degrees of freedom ccjual to the sum of the numbers for the 
seven'll values of x' added- Thus 7^^, the sum of the N values of Tig for 
the N Ijombs dropped in a flight, has approximately the distribution 
with 2N degrees of freedom. Since g flights are made u'ith each sight, 
7'ls has 2qN degrees of freedom, and since h flights of each lot are 
tested, has 2ghN degrees of freedom. Since in the specific plan of 
Sec. 2.1, g — h — 2 and N = A, control limits for may be obtained 
approximately from the 0.01 and 0.05 probability levels for x’ "’ith 
32 degrees of freedom. 

Under this same condition of absence of bias, f? y/N and dr 
have the same joint distribution as r and d. Consequently 

Tig = JV(af* + 2bfd + cd^) 

has, with the same approximation as before, the x* distribution with 2 
degrees of freedom. For the gk flights involved in testing a sample lot, 
the sum Th of these quantities has approximately the x“ distribution 
with 2gh degrees of freedom. For the plan of Sec. 2. 1 this means 8 degrees 
of freedom for Th. 

The distribution of a sum of squares of deviations from a mean is 
independent of the distribution of the mean itself when, as is assumed 
throughout, the fundamenta.1 distribution is of the normal form. In like 
manner the sum of the products of the deviations of r and d from their 
respective means is independent of these means in the probability sense. 
It follows that 

T%p = aS(r — + 2bS(r — fi>)(d — dg) cS{d — dt-y 

independent of Tig. Since 

Tig + Tig = Tig 

and sin(;e l\,g has 2 degrees of freedom while Tor has 2N , it follows that 
Tip has approximately the x® distribution with 2{N — 1) degrees of 
freedom. Since is the sum of gh independent values of Th, the 
number of degrees of freedom for is 2ghiN ~ 1), a number which for 
the plan of Sec. 2.1 equals 24. 

It is assumed in the foregoing paragraphs that r and d are free from 
bias. If there is a bias, the same in the new as in the old bombings, 
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r — f' and d ~ d' will be free of bias but will have variances 1 + 1/n' 
times those of r and d, respectively. (Here n' is the number of bombs in 
the old sample, equal to 260 for the base period considered.) Hence, if 
we replace r and d, respectively, by 



and 



in the resulting statistic 




a{r - ry + 25(r - f')(d - d') + c(d - d'Y 


1 + 


1 


has the distribution that would have in the unbiased case. The sum 
fli, of Ngh values of therefore has the same approximate distribu- 
tion Arith 2Ngh degrees of freedom as 

The mean range fp for the N bombs of a flight differs from the mean 
range f for the n' bombs of the base period by an amount whose variance 
is 1/.^ + l/n' times the variance of range in general. The like is true 
of the difference dp — d'. Consequently 

_ aifp - ry + 2bifp - n(dp - dp -h c(d;, - 3-y 


has the same approximate x* distribution as with 2gh degrees of 
freedom. 

These approximate distributions require correction for the limited 
number n of degrees of freedom of the sample in the base period, If a 
base period \vith a value of n less than, say, 100 were taken, the correction 
would be substantial. As the value of n increases, the exact x‘ distribu- 
tion is approached as a limit. 

No study of the e.xact distributions of the various T statistics here 
used has been published except for the simplest case. The probability 
that Tob should exceed any assigned value T is known to be* 

(, ^ 

This is the special case for p = 2 of the distribution of the generalized 
Student ratio given by 

where U, is the element in the fth row and jth column of a p-rowed sym- 
metric matrix inverse to the matrix of sample covariances Sa between x, 
• See Hotflling, "Generalization of Student's Ratio.” formula (26). 
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and Xj found in a former sample with n degrees of freedom for each of 
the p variates. The element of probability for this generalized Student 
ratio, namely, 

2r(^) 


TP-^dT 






approaches that for x with p degrees of freedom when 7i increases. The 
probability integral of this distribution may l>e evaluated in various ways, 
one of which is to use the asymptotic expansion* 


. _ ■ r, P + , 4 - + (2 + + ST* I 

^ ^ L 2a ^ 24n* J 

in conjunction with the x* distrilnition. From it may be obtained the 
asymptotic expansion for T* in terms of x*, namely, 


r 




1 + 


P+ 7 p» - 4 + (13p - 2)x= + 4x * 


2n 


24n* 


This formula is particularly suitable for determining the values of 3’* 
corresponding to any particular probability level from those already 
tabulated for x^- 

Probabilities connected with the T distribution, or values which will 
be exceeded \vith assigned probabilities, can also be evaluated by means 
of the transformation 

n — p 4- 1 


where F has the variance ratio distribution, of which tables are available, 
with Ui ~ p and ns = n — p + I degrees of freedom. This method is 
particularly suitable for small values of n. 

This known T distribution may be used temporarilj; as an approxima- 
tion for the distributions of the T statistics used in the plan presented in 
this chapter. It has been so used in obtaining the control limits listed 
in Sec. 2.2.6, which are shown in Figs. 3.5, 3.6, and 3.7. For this approxi- 
mation the p of the foregoing formulas is replaced by the number of 
degrees of freedom /, which in Sec. 2 has the values 8, 24, and 32 for 
Tmi, Tdl, and Tol, respectively. In general, / equals 2gh, 2gh{N - 1), 
and 2ghN for these several cases.f 

* See HoTELUPfoand Fbankbl, “Transformation of Statistics,” p. 96. 

I An article on the mathematical theory of this chapter; which is expected to 
appear in the Annals o/ Mnthemaficnl Slatistiefi, will include the exact distrihiition of 
these T’s. 
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3.4.2. Yardsticks for the 7’*s. — ^The values of T- obtained from differ- 
ent flights are not exactly independent in the probability sense, since 
they involve the same valtics of a, 6, and c, which arc subject to the 
sampling errors of the base period, which will be small if n is large. 
For this reason it appears that the several values of will have positive 
correlations, but that these will be vciy small when n is as large as in the 
sample here considered. Apparently no great error will be made by 
assuming independence. 

Pending the development of a more exact treatment, \re may obtain 
yardsticks for the T charts by assuming independence and attributing to 
each T the x distribution. The ratio of two indepondent values of F®, 
each with / degrees of freedom, has thus approximately the distribution 
of the ratio of two independent values of x®, that is, F, with ni = rii ~ f. 
Since yardsticks are desired wdth a probability 0.05 of being exceeded 
in length on the logarithmic scale, the tables of the 2>^ percent points 
of F may bo used. The values of / for single flights are 2A'’, 2, and 
2(A^ — 1) for Tc, Tu, and To, respectively. These values of / are to be 
multiplied by for sights aud by gh for lots. 

4. BACKGROUND AND REASONS FOR THE PLAN 
4.1. Objectives of Sampling Inspection 

Apart from special experimental and exploratory purposes, two 
principal objects can be gained efficiently by means of routine inspection 
and testing of small samples, and a third object can at the same time be 
attained in a somenhat less adcq\iate fashion. From small samples 
it is possible 

(1) To judge efficiently the general level of quality of the product of 
a factory or a part of a factory over a period, in comparison with the 
output of other productive units, and of the same uuit at other times. 

(2) To detect promptly irregularities, trends in quality, and devia- 
tions from customary levels. 

(3) To select ^nd reject individual bad articles, or bad lots. This 
function is often consiticred the primary one. However, the efficiency 
of small samples for this purpose, when the proportion of defectives 
that can be tolerated is small, is not so satisfactory as is sometimes 
imagined. This has beeen brought out in a recent article, "Rational 
Sentencing," by Dr. E. H. Sealy. 

On the basis of the small samples (5 to 10 per lot of 2,000) which it is possible 
to fire at aiiiiiiunition proof, it is quite impossible to distinguish between the 
qualities of individual lots, or to sort out individual bad lota from the bulk in 
any but the grossest cases. Proof specifications of the type which state that 
a lot will be accepted if its proof is clear and rejected or reproved if certain defects 
appear at proof have very little effect upon the quaUt 3 ' of the bulk being inspected. 
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This has often been demonstrated in cases where the test is nondestructive by 
100 percent inspecting the bulk both before and after proof. The percentages 
defective found at 100 percent inspection of the accepted and rejected lots are 
almost invariably found to be nearly equal and both very little different from the 
percentage of defectives in the original bulk presented for proof. In other words, 
the quality of the product passed into the service under such a sentencing system 
is practically that which happens to be made at the factojy. . . . 

It is, then, quite impracticable to attempt to discriminate between individual 
lots by means of a small sample proof. What we can get, however, from such a 
proof is a knowledge of the average, over-all quality of the product of any given 
factory, for the accumulation of many small sample proofs amounts in time to 
bulk of evidence which there is no gainsaying. ... 

Broadly speaking, then, the object of rational sentencing ie not to sort out 
individual good and bad lots but to estimate qualities assumed to be reasonably 
constant. If we estimate that, over a long i)eriod, a firm produces consistently 
a product no better than 3 percent defective, then if we nceil this firm’s produc- 
tion, we must perforce accept it as a whole along witli its 3 per cent of defectives, 
for this is the best this firm can do under its present state of knowledge and equip- 
ment. In such a case there will be, on the average, about 00 defectives in each 
lot of 2,000, and clem ly, by chance, when picking a sample at random from a lot, 
one or more of these 00 defectives will from time to time be found. But it is 
irrational to suppose that the lots, none of whose 60 defectives chanced to be 
chosen in the proof sample, are any better than the others. 

Dr. Sealy has elsewhere* shown the great difficulty of devising a 
practical small-sumpic scheme that will reduce to reasonablo dimen- 
sions both the producer's risk of having good lots rejected and the 
consumer's risk of fiaving bad lots accepted, when the definition of good- 
ness is that the proportion defective in a lot shall be not more than about 
2 percent. His work is, however, confined to case.*? in which the result 
of the in.spection of each article Is merely to elas.sify it a.s rJefertive or 
passable. The crudeness of this type of inspection in comparison w’ith 
quantitative measurements is partly responsible for the difficulties he 
emphasizes. With the relatively refined stat^tical methods recom- 
mended in this chapter for quantitative measures of bombsight quality, 
the chances of detecting a bad lot are much greater than by the simple 
procedures whose limitations he points out. The fact remains, hovv'ever, 
that too much should not be expected of small samples from the stand- 
point of catching infrequent defects. 

One Way to meet this difficulty is to increase the size of the sample 
by lumping together successive lots, while keeping the same proportion 
of inspection, so as to have laiger samples. This procedure, however, 
introduce,? new and formidaldc difficulties. It is objectionable to keep 
lots of thousands on hand for the long periods required, for selection and 


• “Acceptanco Sampling.” 
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testing of samples; and, more fundamentally, production conditions are 
likely to change considerably during the accumulation and testing proc- 
esses for such samples, so that the homogeneity necessary for accurate 
inferences is lost. 

4.2. Reasons for Random Selection and for Lot Size 20 

It is evident that the detection of individual defective bombsights, 
or small lots of bombsights, needs to be done primarily by tests in the shop 
rather than in the air. i The main reliance for this purpose must be on the 
painstaking, detailed inspection of every sight made by the government 
inspectors at the factory. The inspection at the proving ground of 10 
percent of the sights can be only a partial check on the inspectors at 
the factories, incapable of reliability in detection of bad small lots or 
individual sights in any l^ut the grossest cases. 

The real functions of testing and inspection at the pro\’ing ground 
must be taken primarily to be the two set forth at the beginning of the 
preceding section, namely, (1) the continuing appraisal of general level 
of quality, and (2) the detection of trends, excessive irregularity, and 
differences between sights produced at about the same time in the same 
factory. 

To carry out these functions it is essential to have at the proving 
ground sights chosen at random. Selection of those apparently the 
worst, as has been, done in the past, introduces not only a bias, which 
could be compensated by calculation after the accumulation of experience 
with sufficient numbers chosen at random, but the much more serious 
difficulty of excessive variation. To carry out accurately the two 
leading functions of sampling inspection on the basis of samples thus 
selected is practically impossible. The worst, or the least, or the greatest, 
wth respect to any characteristic, in samples of 10 or more has a distribu- 
tion far removed from that of the general population from which the 
samples were drawn, not only in average level, but also in variability 
from sample to sample and in the form of the distribution. It is these 
considerations that lead to the recommendation to select 10 percent of 
the output at random, in place of taking the worst 1 in 10. 

We do not recommend taking 1 in each successive lot of 10 at random, 
but rather taking 2 at random from each of successive lots of 20. This 
might be replaced by taking 3 at random from each of successive lots of 
30, or similarly with large numbers. However, the use of these larger 
lots would mean delay while they were being accumulated and would 
increase the trouble with fractions of lots remaining as tag ends with every 
change of model. An even more cogent objection to large lots is that 
the larger the lot the greater is the chance of some change in the condi- 
tions of production while it is being accumulated. Such a change means 
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heterogeneity within the lot, which w'eakens the inferences from it, and 
means that the existence of the change is not likely to be detected so 
soon as if the lots were smaller. It is particularly important that 
deteriorations in quality be discovered promptly, in order that further 
defective sights may be prevented before a great number of them accumu- 
lates. These considerations lead to a choice of size of lot as small as is 
consistent "with having a plurality of individual sights chosen at random 
from it. 

The use of 10 percent as the proportion of sights to be sent to the 
proving ground is neither defended nor opposed here but is adopted as a 
basis of calculation because this proportion has been used in the past. 

4.3. Relation to Experiments} Design 

One reason, for using at least two sights chosen at random from 
each lot is in order to obtain a ready measure of variation within the lot, 
so that excessive differences can be observed with the help of the yard- 
sticks provided for the pur])ose and attention can thus be directed to 
possible heterogeneity in the productive process that might lead to 
deterioration. Another reason is the desinibility of averaging together 
results from different sights of a lot in order to eliminate some of the 
chance variation and make trends and e.vcessive errors more clearly 
discernible. 

These two reasons are feature.? of the modem theory of the design 
of experiments, which rests on the twin principles of replication and 
randomization.* Replication (that i% repetition) has two values. One 
of these i.s the increased accuracy obtainable by averaging the results of 
several observations. The other, which is of the greater importance 
though perhaps less obvious, is the provision of data for estimating the 
variance due to errors of observation, data consisting essentially of 
the differences between the results obtained from e.xperiments in which 
the controlled conditions are the same. Knowledge concerning this 
error variance is necessary before any conclusion can be drawn, since 
real effects can only be distinguished from chance when information is 
available aS’ to the distribution of the chance factor. It is true that 
estimates of chance variance can sometimes be drarsm from other analo- 
gous experiments or from general knowledge; but such estimates are of 
doubtful validity when applied to a new set of data that must inevitably 
differ somew’hat in origin from those provided by older experiments. 
The most satisfactory estimate of variance is that provided by the self- 
contained experiment, which is arranged from, the beginning so as to 

* See Fisheh, DeHgn of Experiments, especially Sees, 9 and 10 of Chap. 2, Sec. 20 
of Chap, 3, and Secs. 25 and 26 of Chap. 4. 
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or alternatively by the median -m, which is defined as the middle observa- 
' tion (when the number N is odd) whciv the observations are arranged in 
order of siae. A set of N indepcadeivt observatioi^ is called a “sample." 
If from. sa.mples of N \ve form the means x, these will have & dis- 
tribution of their own, which happens to he. normal also. The. mean of 
this new normal distribution ho® the same value ^ os the old. But instead 
of the variance u", the distribution of meaua has, for its variance the 
reduced rvalue <r'/iV‘. This reduclion in variance measures the greater 
accuracy in averages by eompaTison ^Y\lh single observations. ^ 

The distribution of mediana from fiamplea of is not of the normal 
form but approjdmutes it if N is large. The variance of this distribution 
of medians is less than that of x but greater than that of the means i. 
The variance of medians is in fact approximafeiy 7r/2, or 1.5708, times the 
variance of means from samples of the same size when N is large. The 
inefficiency of the median is expressed by this greater dispersion, or by 
considering the relative sample numbers required to obtain the same 
accuracy by the median aa by the mean. Tahing the latter point of view, 
and letting Na be the sample size to be used whon the arithmetic mean is 
taken as the estimate of f, while observations (for example, bombs) 
are to be used when the median is taken instead of the mean, we have for' 
the two variances 

•2 _ 1 _ 

"No " 2;Ni 

l( the two variances are to ba equal, the ratio of the sample numbers is 

» 0.6366 

Nl T 

Consequently, the efficiency of the median is said to be 63,66 percent. 
The efficiency of the mean has been demonstrated to be 100 percent; 
that is, its variance hag the gmoUcst possible value. 

The situation is similar with respect to estimates of variance. There 
are infinitely many statistics whose mean values are equal to Amorvg 
all these, the particular siati.stic 

^ " N - 1 

(where S stands for summation over the sample) enjoys the property 
that its distribution has a smaller variance than any of the others. In 
particular, when the mean error (tliat is, the arithmetic mean of the 
absolute values of the delations from the mean) is multiplied by a factor 
such that the mean value of the resulting statistic is <r, this statistic has a 
distinctly mder dispersion than « wbeu the ^mple size is the same. Both 
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these statistics have distributioas approaching normality of form when 
N is large, with the efficiency ratio 

= 0.87597 

T A . 

The ^ide current'use of the mean deviation thus has an efficiency of only 
about 87.6 percent. If bombs are dropped for the purpose of ascertaining 
their dispersion, the use of the mean deviation is equivalent to wasting 
about one bomb in eight. 

Against this waste of bombs may be set the fact that the mean devia- 
tion is easier to calculate than the standard deviation s. The labor of 
calculating s is, however, mucfi less than is sometimes supposed and is 
trivial if a calculating machine of any kind, or even a table of squares, 
vs at hand. The identity 

S(x — — xSx 

means that the individual deviations from the mean need not be com- 
puted. In view of the high cost of aerial bombing, it appears definite 
that the use of mean deviations, and of functions of them, ought to be 
eliminated.* 

4.6. Exact Probabilities 

The standard deviation s defined above has anotlier advantage over 
the mean deviation and all other methods of estimating o- in that the 
exact distribution of s for samples of every size, even the smallest, is a 
known elementary mathematical function, and tables of its probability 
integral are available. It also has numerous other practical advantages 
in more complicated situations, such as those invohdng least squares 
or the analysis of variance. In view of the small samples that must 
sometimes be used, the property of ha\nng readily determinable exact 
probabilities is a valuable one. Asymptotic formulas are somewhat 
dubious in application to particular cases unless a precise limit of error 
is at hand and are thus inferior to exact probabilities. 

The choice of suitable statistics is also influenced by another and 
more subtle criterion of accurately determinable probabilities. This 
is the desideratum that in testing any hypoth^is we should u.se probabili- 
ties that depend on nothing but the observations, together mth any 
numbers that may be specified in the hypothesis. Statisticians have 
often, through lack of existence or knowledge of better methods, used 
formulas for standard errors and other measures of accuracy in which 
were involved unknowm parameters. The practice has been to substitute 

* See Fishec., “Mean Error and Mean Square Error." For a discussion of the 
general theory of the efficiency of statistics, see Fisher, “Theory of Statistical Estima- 
tion,” and “Statistical Theory of Estimation." 
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for these parameters estimates of them obtamed from the sample. I’his 
substitution however entails an additional sampling error not under con- 
trol. Modem statistical tJieory has succeeded in devising various ways of 
overcoming this difRculty. The statistical methods recommended in 
this chapter all fulfill the criterion that the associated probabilities are 
exact, free from unkno^vn nuisance parameters. This is true in particular 
of the, measures To, Tit, and Tt, combining range with deflection errors. 
If the new observations are from the same population as the old and if 
this has a nomial distribution, then the distribution of each of these T's 
is absolutely independent of all unknoum parameter. Only the sample 
numbers are involved, and tliese are of course known. To pass from the 
observations to the relevant exact probabilities through these T’s is a 
purely mathematical operation, involving no clement of judgment. It 
is true that the available tables do not cover fully the T distribution, 
60 that asymptotic approximations must be used for the present, but this 
is a defect that can be remedied with only a little more mathematical 
research and calculation, ^'hc probabilities respecting 7'm can be found 
easily and accurately from existing published tobies when only one flight 
is involved, but the combination of these values for different flights loads 
to a more general distribution,* which is also applicable to Ti, and To. 

4.6. Reasons for the T Method of Combining Range and Deflection 
Errors 

The particular method of combining range with deflection errors 
represented by the T formulas may be questioned. To many it will seem 
more natural to use measures, apparently simpler, based on the simple 
distances from the bombs to the target. After all, It will be said, the 
ultimate value of a bomb aimed at the enemy depends only on the simple 
geometrical distance from its point of impact to the target, and not on any 
figurative measure of distance that is constant along ellipses instead of 
circles. The simple distance has a clear meaning, intelligible to everyone. 
Tt can be measured on a map withoiit reading off coordinates. Why not, 
then, use a criterion of excellence of bombing depending, in an inverse 
sense, only on the distances of the bombs from the target? 

The several distances might be combined by simple averaging, or by 
taking the mean square, or in numerous other ways. Use of the mean 
square, or the sum of the squares, of the distances, has a special attrac- 
tion in that the sum of the squares of the distances of the bombs from 
the target equals the sum of the squares of their distances from the mean 
point of impact, plus the product of the number of bombs by the square 
of the distance fron^ the mean point of impact to the target. This 

* Tbia mathematical gap has been filled in since the abo've text veas ■written. The 
results are expected to appear in the Annals of Alathematical SCaiislics. 
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reJation, which is analogous to 

Tl = Tl,+ n 

makes it possible to examine separately two components of the total sum 
of squares that may he due to quite different causes. Furthermore, 
estimates of the circular probable eiTor and similar parameters have 
greater statistical efficiency, that is, smaller standard errors for a given 
number of obser\'ations, if based on the sum of squares instead of the 
simple sum or mean of the distances. 

But the efficiency even of the mean square circular error for estimating 
the general degree of dispersion is less than that of To or To, provided 
the base period sample is representative of the true distribution as 
regards t]fie ratios of the variances of range and deflection, and as regards 
the correlation. If the true mean point of impact is unknonm or if we 
choose to ignore it, the best available measure of general degree of dis- 
persion is Td or a function of To. If the tme mean point of impact could 
be assumed to be at the target, the best mcasxire of general degree of 
dispersion would be To or a function of To. Such measures have smaller 
variances than measures of tlie same parameter based on the mean square 
circular error in a ratio which, if we can trust the experience described 
in Sec. 5, is slightly lees than 82 percent. This implies that the estima- 
tion of dispersion can be carried out with about equal accuracy with 82 
bombs if To or To is used, or with 100 bombs if the mean square circular 
error is used. The simple mean of distances from the target or from the 
MPI, or any estimate involving mean deviations, w'ould require distinctly 
more than 100 bombs to gain the same accuracy obtainable with 82 
bombs svhen T is used. 

The seemingly paradoxical result emerges that, to obtain the best 
possible estimate of the mean square deviation from the target to be 
expected in later bombing under like conditions, the mean square devia- 
tion from the target in the observed cases should not be used. Likewise, 
to estimate the mean deviation from the target as accurately as possible 
for the future, the mean deviation from the target in the past should not 
be used. The same is true of shooting and of all other situations in 
which the joint distribution of two or more variates docs not liavo 
circular or spherical symmetry. Indeed, for any given set of ratios 
among the variances and covariances, the mean square deviation from 
the target and the mean deviation from the target for the population of . 
bombs or shots, from which our observations constitute a sample, are 
definite multiples of a parameter measuring general degree of dispersion; 
and such a parameter is best estimated by a quadratic expression of the 
T'^ type. 

For detection of bias in the mean point of impact, the use of Tu 
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has advantages over all other methods that have been studied.* It is 
true that when only a bias in a specific direction, such as that of range 
errors, is to be considered and it is certain that there is no bias in any other 
direction, the mean of the components of deviation (positive and negative) 
in the particular direction is the most efficient measure, while the use of a 
measure of bias in all directions weakens somewhat the test for a bias 
in the particular direction. This difficulty is, howeVer, ine-scapablc 
when there is any real importance and likelihood of errors of bias in more 
than one direction. If a rule were established that a bomb should be 
classed as “bad” if its range error were such as to be exceeded with 
probability 0.01 and it should also be classified as bad if the deflection 
error were such as to be exceeded with probability 0.01, there would be 
some danger of misunderstanding. Many persons would suppose that 
the probability of a good bomb being wrongly classified as bad under 
such circumstances is 0.01, whereas actually this probability is in the 
neighborhood of 0.02. Such erroneous ideas abound in statistical 
practice in many fields. Use of the combined measure Ta avoids this 
difficulty. 

The T statistics arc algebraic invariante and as such possess certain 
desirable properties. Any transformation of coordinates such as a 
rotation of axes or a change in units of measure, if applied both to the 
old and to the new observations, leaves each of the 7”s invariant and 
therefore does not affect the probabilities involved. This same property 
of invariance is also important in obtaining the relevant probability 
formulas. It implies the very important fact that the probabilities 
associated wth the T’s are exact numbere, not functions of nuisance, 
parameters whose values arc never exactly knoANH. 

There may be a thought that instead of T another invariant kno\vn 
as the “generalized variance^' might be used. t The generalized variance 
has many important potential uses. However, it is not so suitable as 
T for the purposes here in view because, in two dimensions, it is essentially 
a measure of distance (in a generalized sense) from a line instead of from 
a point. IMiile Tu and To can be zero only if all the bombs fall on the 
target, and To can be zero only if all the bombs fall on one point, the 
generalized variance will be zero if all the bombs fall on any one line, no 
matter how they are scattered along it. This consideration also elimi- 
nates for the present purpose several other statistics obtained by maxi- 
mum likelihood methods. | 

An objection likely to be made to the T formulas is against the inclu- 
sion of the term in the product of range by deflection errors. If the 

* See Hsu, “Generalized T”; Wald, “Testa Concerning Several Parameters.” 

I Wilks, “Generalizations in the Analysis of Variance.” 

J Pearson and Wilks, "k Samples of Two Variables.” 
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correlation between range and deflection in the sample in the base period 
were exactly zero, this term would be zero. It may be argued on a priori 
grounds that the true correlation is zero, and that when, as in the sample 
here used, the observed correlation is only slightly greater than its stand- 
ard error (Sec. 5 gives, after adjustments, a correlation of —0.07535, which 
is 1.2 times its standard error), later Avork should proceed on the fixed 
assumption that the correlation is zero. A further extension of this idea 
might lead to ignoring the difference betAveen the variances of range and 
deflection, and consequently using the mean square deviation, whose 
inefficiency has been described above. 

While omission of the small product term from Avould seem at 
first to save a little computational labor, it would lead to great mathe- 
matical complexities in connection with the probabilities. The resulting 
function is not an invariant, and its distribution involves as a nuisance 
parameter the ratio of range variance to deflection variance in the popula- 
tion, which is estimated by the sample only Avith an uncertainty that 
makes highly dubious any probabilities calculated on this basis. More- 
over, if it should turn out that there really is some correlation between 
range and deflection errors, Avhether the causes and magnitude of such 
correlation are known or unknowTi, this correlation would constitute an 
additional nuisance parameter having serious effects on the accuracy 
of judgments based on the observations. In this connection it should 
be recalled that, while the particular sample here considered does not 
establish existence of a correlation, other reports seem, at least super- 
ficially, to show high and significant correlations between lange and 
deflection errors in practice bombing. Some officers are of the opinion 
that a real correlation exists. 

Another way of avoiding the calculation of products of range by 
deflection errors would be to make separate tests of significance for range 
and deflection, using the variance ratio distribution, and then to combine 
these by the method of combining independent test probabilities pro- 
pounded by Fisher and studied by Wallis and others.* This method 
requires use of the exact probabilities rather than of the values of the 
variance ratio at a fcAV points such as those for probabilities 0.01 and 
0.05. Consequently, the tables of the F distribution must be used twice 
for every such test and thus for every point plotted on control charts 
corresponding to those for Tu, Tp, and To. The labor involved Avould 
amount to far more, and the a.ssumptions necessary for validity are more 
stringent, by this than by the T methods. 

The methods based on T arc valid and accurate Avhether a true cor- 
relation exists or not, and whatever the ratio of the true variances may be. 

•Fisher, Statistical Methods, See. 21.1 of Chap. 4; Wallis, “Compounding 
ProbabiJities.” 
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The only limitations on this statement are in the assumptions of normality 
and independence, which are made throughout, not only in the present 
discussion but in virtually the whole literature of bombing and firing, 
including that concerned with methods of combining observations. 
These assumptions, in relation to test bombing, are discussed in Sec. 
3.1,4, pp. 146-147. 

6. STATISTICAL ANALYSIS OF CERTAIN TEST BOMBINGS 
6.1. Summary of the Data 

In order to obtain variances in range and deflection, and a correlation, 
from which the coefficients a, b, c in could be found, a series of 65 
flights was analyzed. These consisted of all those flights at a certain 
proving ground between November 4, 1942, and December 23, 1942, 
during which exactly four bombs wore dropped. The coordinates 
of the point of impact of each bomb with respect to axes through the 
target, of which one is an average track for the whole flight, were supplied 
by the proving ground, togetlier with the heading of the airplane when 
the bomb was dropped and other data. Two of the bombs on each 
flight were dropped while the airplane was moving in a generally northerly 
direction and the other two while it was flying in a southerly direction. 
The actual headings, however, varied considerably^ the diflerencc betn-een 
the two in the same general <lircctioa on the same flight being commonly 
several degrees and in one case amounting to 25 degrees. TVe therefore 
applied to the coordinates received a rotation designed to give the error's 
in range and deflection xdth I'cspect to Che actual heading of the airplane. 
Table 3.1 gives the principal statistics summarizing both the original 
data on range and deflection and the values as adjusted by these rotations. 
Except for the ficat column of this one table, all numerical results given 
hereinafter will refer to tho rotated values. In each case r denotes the 
error in range and d the error in deflection. Positive values of r refer to 
bombs overshooting the target, negative values of r to bombs that fall 
short. Deflection errors to the right are considered positive; those to 
the left are negative. The unit of measure is in each case the mil, 
about 1/1,000 of a radian, or about 2/35 of a degree. The data as 
received refer to actual impacts, uncorrected for diffei-ential ballistic 
wind, nonstandard altitude, nonstandard air speed, or range component 
of crosstrail. The actual altitudes are understood to have fluctuated 
rather widely about 7,000 ft., but since the errors are measured in mils 
the effects of these altitude variations on the results of the analysis 
should not be great. 

If any one rotation had been applied to ail tho points of impact, 
the squared distance + d* of the mean point of impact from the target 
would be invariant. The fact that + d* has two different values, 8.83 
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for the original and 9.67 for the rotated data, results from the differences 
of the rotations applied for the different bombs. 


TABIiE 3.1 

SuJis/Aur OF HoMBisa Ebrobs in 65 Flights (260 Bombs) 
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Among tile 05 flights there were variations with respect to both 
personnel and equipment. Ten different teams, each consisting of a pilot 
and a bombardier, were represented. The number of flights made by a 
team varied from 1 to 17 in the several cases. Automatic Erection 
System (AES) was used in 24 cases and Stabilized Bombin^Approach 
Equipment (SBAE) in 8 cases. The distribution of the flights in relation 
to personnel and equipment is shown in Table 3.2. The first columns 
designate the pilot and the bombardier by their initials and indicate the 
combination of the two by a number. 


TABLE 3.2 

Disttodution op Flights by Personnel and Equipment 
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5.2. Analysis of the Data 

The primary object of the analysis was to obtain suitable coefficients 
a, b, and c for use in the expressions for that are to measure the accu- 
racy of individual bombsights. However, the variances entering into 
these expressions are presumably affected by the variations of equipment 
and of personnel among the flights examined. It is to be expected that 
this heterogeneity will increase the sample variances above the values 
they ■would have if equipment and personnel had been kept constant on 
all the flights. Such an increase of variance would reduce the values of 
a, 6 , and c, and therefore the values of T* computed from them in future 
tests, giving an illusory impression of accuracy in those tests in which 
equipment and personnel are close to the average situation in the cases 
analyzed. To determine whether this is a serious bias and to correct 
for it if it is, it seemed desirable to consider regression equations for 
predicting the range and deflection errors in terms of equipment and 
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’personnel. At the same time, the opportunity was at hand to obtain 
tentative estimates characterizing the performance of particular teams 
and of the particular types of equipment and to test the accuracy of 
these estimates. 

Several different regression equations were used. In the first instance, 
to make a rather-extensive elimination of extraneous factors, we con- 
sidered regression formulas \rith no less than 79 terms. Besides an 
additive constant, these terms were 

xi, defined as 1 if AES was used, and otherwise 0 

Xi, defined as 1 if SBAE was used, and othermse 0 

xs, defined as 1 if the airplane was flying north, but 0 if it was flying 
south 

x'i, (i — 1, 2, t 10), equal to 1 if the bomb was dropped by the 

tth team, and otherwise 0. The number of variables in this 
group was of course iO, the number of teams. 

X,", (f « 1, 2, • • • , 10), equal to 1 if the bomb was dropped on the 
jth of the (lights of the tth team, and otherwise 0. The number 
of variables in this group was 65, the same as the number of flights. 

Two different prcdictands, the range and deflection errors, were used with 
this same set of predictors. The regression equation for estimating 
range error in terms of all the predictors was of the form 

10 

R ==h+ b,x, + hx: -h/>,x,+ 2 l>kl + 2 

with a similar formula for estimated deflection error D. The coefficients 
were determined by the method of least squares. 

It might seem that the solution of a least-square problem with 79 
unknowns would be an utterly fantastic task, to say nothing of two such 
solutions. Yet through .special circumstances it was possible not only to 
carry through this calculation completely, with the relevant standard 
errors and tests for significance in terms of probability, but to do so 
with a very modest amount of computing. One of these circumstances 
was that, because of the nature of the variables, a large majority of the 
elements of the matrix of the normal equations were zero. Also, a 
simplification was obtained through choice of 13 linear relations that 
can be imposed somewhat arbitrarily upon the regression coefficients 
because of 13 identical linear relations among the predictors, which 
reduce the rank of the 79-rowed matrix to 06. These 13 identical rela- 
tions express the following facts: 

The sum of the values of xJJ for all the flights of the rth team equals 
x'i. There are 10 of these relations, corresponding to the 10 teams. 
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The sum x'l + x'i -h • • • + arjo = 1 

The sum. of the vahies of for all flights using AESHs zi 

The sum of the values of for all flights using SBAE is Xs 

A linear constraint corresponding to each of these was placed upon 
the regression coefficients in each grovip in order to make them deter- 
minate. Though it is customary in problems of this kind to use tlje 
simplest constraints by merely equating to zero the sum of the coefficients 
in each group, u’c chose a dilTei'ent set of constraints adapted to simplify- 
ing the numerical work. For example, where a constraint of the form 

h; + + ■ - • + r>;o = 0 

would ordinarily be impose<l, \vc used instead 

176; + 106'j 4- 76'3 + - • • + 6;^ = 0 

■with coefficients equal to the numbers of flights of the respective teams. 
This made possible a great reduction in labor because of the occurrence of 
this particular linear combination in tlie normal equations. All results of 
importance involving the 6'’s will neces.snrily be in terms of their differ- 
ences and do not seem to be affected by replacing one such constraint by 
another. 

The solution, of the normal and constraining equations was carried 
out literally, in terms of symbols for the right-hand members of the normal 
equations, instead of numerically. In this way it was easy to obtain 
the two regression equations, one for range and the other for deflection 
errors, by substituting the two sets of right-hand membe^. Further- 
more, tlie litoral solution made easy the determination of standard 
errors and correlations among the regression coefficients in either equation. 
Thus it playc<l somewhat the same role as that of the inverse matrix in 
least-square problein.s involving no identical relations or constraints. 

The question whether there was significant variation among the 10 
teams with regard to bias in range and deflection errors was tested by 
means of the variance ratio distribution. The denominator of this ratio 
was the estimate of variance based on the sum of squares of residuals 
from the regression equation. Since there were 2C0 observations and 79 
regression coefficients connected by 13 constraints, the number of degrees 
of freedom for this residual variance was 2C0 — (79 — 13J = 194. The 
numerator was a quadratic form in the 6"s with 9 degrees of freedom, 
since they are subject to the one relation indicated above. The value 
of such a quadratic form can be found by first Snoring any one of the 6'’s 
(which ^\'e arbitrarily chose as 6^), inverting* the covariance matrix of 

* Several methods of numerical inversion of matrices aro described in Owycr, 
“Solution of Simultaneous JCquations” and Hotelling, “Matrix Calculation.” The 
method given by Dwyer is p-articularly valuable. 
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the other nine corresponding to unit variance of residuals, and then 
calculating straightforwardly the quadratic form of which this inverse 
is the matrix and in which the variables are the nine 6"s used. This 
has only to be divided by 9 to give the numerator of the variance ratio, 
essentially an estimate of variance among the 6"s, but differing from a 
mere sum of squares of their deviations from their mean because of their 
unequal weights and correlations resulting from the unbalanced dis- 
tribution of equipment and personnel. The inverse matrix is the same 
for range as for deflection errors, since it depends only on the distribution 
of the predictors and not on the pi edictands. 

For range errors the variance ratio F found in this way was 1.423; 
for deflection errors it was 1 .426. These are considerably less than the 
value 1.923 of F that would just be regarded as significant on the cus- 
tomary 0.05 level and indeed are little greater than the value that would 
be exceeded by c!\ance with probability 0.20 if the true mean range and 
dcflecti(jn deviations were the same for all teams. 'J'hus no evidence 
pointing to any variation among teams in these biased errors emerges 
from this test. 

With two variates such as range and deflection errors the two separate 
tests may, with a substantial increase in accuracy, be replaced by a 
single tost. In place of the foregoing variance ratios we may well con- 
sider a combined test due to Wilks.* Each variance is replaced in 
this test by a symmetric two-rowed determinant. The elements of the 
denominator determinant are the variances .and the covariance of range 
and deflection as estifnate<l from the residuals from tlie two regression 
equations in which they are the prcdictands. The numerator deter- 
minant's elements arc the fwo quadratic forms computed from the two 
sets of 6"s, and the bilinear form with the same matrix and involving 
l)oth sets of 6"s. The value 1.C90 obtained for this generalized variance 
ratio would be exceeded by chance with a probability considerably greater 
than 0.05, though much further below 0.30 than in the separate variance 
ratios for range and deflection. Thus even this more sensitive test 
fails to give real evidence of variation in mean point of impact among 
the men engaged in dropping the bombs. That there is a real bias, at 
least in deflection, is easily inferred from Table 3.1 or from other bombing 
records. Apparently the bias is much the same for all the 10 teams on 
whose performance these records are based. 

Application of the corresponding tests for the effect on the MPI 
of AES, of SBAE, and of direction of flight w'as much simpler because each 
of these effects corresponds to only 1 degi'ee of freedom, so that the test 
for either range or deflection reduces merely to the comparison of a regres- 
sion coefficient with its standard error. When AES w'as used, the MPI 

* Wilks, " Generalizations in the Analysis of Variance.” 
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was 1.6536 mils farther in the “short’* direction than as if it had not 
been used, according to the regi*ession coefficient, which makes allow- 
ances for effects of SBAE, direction of flight, and personnel. This 
coeflScient is statistically significant on the customary 0.05 probability 
level. Since the MPI for all the bombs was 1.3450 mils “over," the use 
of AES appears to have been advantageous in this respect. The cor- 
responding coefficient for deflection was not significant, and the combined 
test by Wilks’s ratio of determinants also failed to yield a significant result 
on the 0.05 level. The same tests applied to SBAE gave results far from 
significant, suggesting no difference according as this equipment was 
used or not. a 

The effect of direction of flight on MPI waa tested by means of the 
coefficient 63 in the 79-term regression equation. For range the effect 
was insignificant. But for deflection the value —4.1045 was significant 
even on the O.Ol level. This indicates that the bias toward the right was 
considerably less flying north than flying south. 

The variations of MPI among flights were tested by an appro-ximate 
method, simpler than that used for personnel variance, which would for 
65 flights Avith 53 degrees of freedom have involved the considerable labor 
of inverting a matrix of 53 rows. Such a piece of calculation is not so 
completely out of the question as would once have been thought, but it 
did not seem worth while for the present purpose. By ignoring the 
unbalance occasioned by disproportionate frequencies of equipment and 
personnel, while utilizing the balance of north and south flights and the 
fact that exactly four bombs were dropped on each flight, these considera- 
tions lead to the estimate of variance among flights. This 

turns out to be insignificant for deflection but significant for range. 
The combined test for range and deflection failed to yield a significant 
result. Thus any important effect on MPI of variations among flights 
seems to be confined to the range components. Such variations refer 
to effects of varying weather and other factors not taken into account 
in the regression equation but do not include the variations of personnel 
and equipment considered. 

Since it is to be expected that pilots and bombardiers will change 
from time to time, as will also the weather, the variances of deviations 
from the 79-tcrm regression functions will be less relevant than if the 
effects of the fluctuations had not been eliminated. If the personnel 
were to remain constant, and of constant ability, and if an adequate 
measure of seasonal variation were available from records over a period of 
years based on ore-filled bombs, the appropriate estimates of variances 
and correlation for appraising bombsights under test would be in terms of 
deviations from a regression equation involving all these factors. The 
omission of the terms in the regression function corresponding to per- 
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sonnel may also be justified on the ground that, as seen above, no dis- 
cernible differences between the MPI’a of different teams have been 
found. 

Inclusion of an allowance for equipment type does seem to be needed, 
first because of the highly significant difference in MPI associated with 
AES, and second because of the prospect that future standardization 
will, lead either to the use or the nonuse of each of the types of equipment 
with all sights tested alike. Furthermore, it is to be hoped that methods 
will be found to eliminate the difference between the !MPI of bombs 
dropped on northward and on southward flights. The values recom- 
mended for the coefficients o, b, and c of the test functions to be used 
for future control charts have therefore been based on the residuals 
from regression functions with only four terms. Besides a constant, 
these terms involved 

:Ci, which equals 1 if AES was used and is othen\ise 0 

Xi, which equals 1 if SBAE was used and is otherwise 0 

X8, which equals 1 if heading was north, but 0 if heading was south 

These regression equations were found to be, for range errors in mils over, 
Ji = 2.9125 - 1.4457x1 - 2.8149x2 - 1.3746xs 
and for deflection, measured in rails right, 

D = 5.4099 - 0.8100x1 - 1.0176x2 — 4.3615x3 

The deviations from either of these regression equations are 260 
in number but have only 256 degrees of freedom because of the four 
constants in the equation, in accordance with well-known least-square 
theory. The sum of squares of these deviations from one of the equa- 
tions, divided by 256, gives the estimated variance in range or deflection. 
In the same way, the sum of products of deviations from the two equa- 
tions, divided by 256, gives the estimated covariance. These values are 

Range variance «* = Su = 40.294995 

Deflection variance sj = s-s = 70.033392 

Covariance Sni = sis = —4.290599 

From these values a simple calculation gives 

Sr = 6.8040 mils sj = 8.3086 mils r = —.07535 

the estimated values mentioned in previous parts of this chapter of the 
true standard deviations cr^ and aj and correlation p. The number 256 
of degrees of freedom is large enough to make the estimates Sr and Sd 
quite reliable. The standard error of each of these standard deviations 
is only about 4.42 percent of its value. That of r is exactly making 
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the correlation only 1.200 times its standard error. The probabilitj’ of 
so great a value of [r[ in the absence of any real correlation is about 0.23, 
so that the hypothesis of independence between range and deflection is 
not refuted by these data, though there is a faint suggestion that bombs 
that fall short tend to fall to the right, while those going over the target 
tend to fall to the left. 

The inverse of the matrix 



and from the above values we lind 

a = 0.021724 h = 0.()U1331 c = 0.014360 
the values used in the plan presented in 8cc. 2. 

6.3. Ratings of Equipment and Personnel by Test Bombing 

A series of test bombings can be utilized to obtain infonnation not 
only regarding the sights u.sed, but at the same time regarding other 
equipment and the men who do the flying and drop the bombs. For each 
flight supplies a measure of the general success, and this is easily 
analyzed into the components T% and 7’^ corresponding, respectively, to 
deviations of the MPI from the target and of the bomb.-^ from the MPI. 
By combining the values of Tfy (or of T% or of Tf.) for all the flights on 
which a particular kind of equipment was used, or on which a particular 
man or team flew, and contrasting with the flights not involving the 
same men and equipment, it is possilfle to obtain rating.s of personnel 
and equipment. Approximate pr(»bability distributions are available 
for testing the reliability of such ratings, since each sum of independent 
values of T- may with little error be Hoarded as having the x’* distribu- 
tion, and the ratio of two such sums the F distribution. Since several 
kinds of equipment in addition to the personnel can thus be rated on 
the basis of the same bombing records, such multipurpose test bombing is 
relatively very economical and productive of information. 

Complete validity of such ratings is, however, essentially dependent 
on a condition that must be provided before the bombings, not aftenvard. 
This condition is that, subject to whatever general restrictions are appro- 
priate, the assignment of personnel and equipment to particular flights 
must be strictly at random. There is no waj' of doing this except 
by the use of the actual mechanism of games of chance, or of their 
equivalent in the form of tables of random numbers. In the absence of 
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such objective chance, the assignments must be made by human beings. 
Experience iias clcaviy shown that human beings unaided by gambling 
equipment are unable to assign different test materials to different 
experimental trials in such a way as to avoid bias, cither in the averages 
to which the experiment leads or in the measures of error that must be 
computed as functions of deviations from the oh^erv’^ed averages. Conse- 
(juently, the ratings of the pilots and bombardiei^ in Table 3.4, while 
historically accurate, are subject to the possibility of being explained aw'ay 
by features of the method by which assignments were made. This same 
difficulty qualifies the statistical interpretation of- economic time series 
and other such records which, though frequently the best available 
guides, lach the kind of validity possible only in a well-designed 
experiment. 

To secure rJEczency as well as validity in an experiment, it is usually 
necessary to impose restrictions on' the randomization. Thus in com- 
paring the results of two treatments when the chance variances are the 
same in both cases, the standard error of the difference of the means is 
proportional to s/l/N -I- l/N', where N and N' are the numbers to 
which the two treatments are applied. If N N' has any fixed value, 
the standard error is therefore a minimum when N = N'. Randomiza- 
tion in assignment of the cases to the two treatments should then be 
subject to the condition N = N'. This could bo done by shuffling and 
randomly dividing a pack of cards consisting of black and red cards 
in equal numbers. It could not be done merely'’ by flipping a coin 
once for each case, since the condition N = N' might not then be satisfied. 
This qiie.stion of efficient arrangement of experiments through restricted 
randomization has many ramifications, particularly w’here several 
questions, such as the efficacy of several kimls of eciuipment serving dif- 
ferent purposes, are to be tested simultaneously in the same experiment.* 

Values of Tl, Th, and were computed for each of the 65 flights. 
Graphs of these three functions in the order in w’hich the flights were 
made are appended as Tigs. 3.8, 3,9. and 3.10, respectively. These 
figures “have the general appearance of control charts. They differ, 
however, from suitable control charts in certain respects. Aleasures of 
quality should be plotted on a control chart in the order in which the 
articles are manufactured, whereas here the order is that in ivhich the 
tests w^ere performed. In this material several different series of serial 
numbers w'ere represented, referring to different modifications of design 
and perhaps different manufacturers. It is best to run a separate control 
chart for each modification and for each factory. 

The points in these graphs are on the average higher relative to the 
theoretical probability 0.20. 0.05 and 0.01 levels shown than would be 

* Fisher, Design of Experiments, is the best treatise oa this subject. 





Sec. 5.3 


MDLTIVARIATE QUALITY CONTROL 


179 


Scflif «f Prtlmbintf 





180 


TECHNIQUES OF STATISTICAL ANALYSIS 


Chap. 3 


Scclt of Probability 



'1 (0 oipos 


Sec. 5.3 


MULTIVARIATE QUALITY CONTROL 


181 


expected in a manufacturing and testing routine in a state of control. 
The reason for this lies in a particular feature of the way the charts were 
constructed rather than in any shortcomings of the sights tested. The 
variances on which the coefficients in 7* are based were chosen in Sec. 
5.2 on the basis of deviations from 4-tenn regr^sion functions, in order to 
eliminate from these ‘estimates of variance the effects, which it is, to be 
anticipated arc not to continue long, of the differences between use and 
nonuse of the Automatic Erpetion System and Stabilized Bombing 
Approach Equipment, and between northward and southward flights. 
This elimination has the effect of decreasing the variances somewhat and 
thus of increa.sing the coefficients in each of the expressions fpr T‘. 
If a, 6, and c had been calculated by inverting the two-rowed matrix of 
sums of products of the raw deviations from the target, and if these raw' 
deviations had then been substituted in T$, 7'^, or T^, the average of 
the resulting values would for each of these three functions be exactly 
the number of degrees of freedom, respectively, 8, 2, and 6. If, on the 
other hand, with the values of a, b, and c actually used, r and d had been 
replaced by the deviations from the 4-term regression functions, the 
averages would again in each case be exactly equal to the number of 
degrees of freedom. But because actual deviations were substituted for 
r and d while corrected variances were used in determining the coeffi- 
cients, the averages exceed the numbers of degrees of freedom. Thus the 
average of the 65 values of T% is 9.0078G instead of 8. This is reflected 
graphically in the fact that the proportions of the 65 cases above the 
horizontal lines are in general somewhat greater than the respective 
probabilities. 

From Table 3.3 it appears that AES and SBAE, instead of improving 
bombing accuracy, seemed to make it w'orsc. The significance of this 
apparent effect may be tested (with an approximation equivalent to 
identifying the sample variances and covariance based on 256 degrees 


TABLE 3.3 

Effect of Equipment on Ovbr-ael Accuracy of Bombing 
(Excellent bombing is indicated by Jow values of Tq) 


, ♦ 

Number 
of flights 

''^Tl 

Average 


24 j 


9.51458 

8.71125 

9.94430 

8.87643 


41 1 



8 1 

79.554375 | 


57 1 

505.956688 



of freedom noth the true values of these parameters in an infinite popula- 
tion) by means of the variance ratio distribution mth numbers of degrees 
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of freedom equal to eight times (since each flight has 8 degrees of freedom) 
the numbers of flights \vith and without the equipment in question. 
For AES the ratio is 


9.51458 

8.71125 


1.09222 


with ni = 192 and = 328. This is not at all significant since the 
probability of a greater value of F is considerably more than 0.20. 
Actually, the relevant probability is more than double this value because 
of our selection of the greater mean value of TJ to put in the numerator. 
For SBAE we have « 


9.94430 

8.87613 


1.12030 


w'hich, with ni = 64 and = 456, is similarly insignificant. Thus these 
results do not prove that AES and SRAE have deleterious effects. They 
would not actually prove it in a really satisfactory manner even if the 
results had turned out to be significant, since the as.signment of the 
equipment to particular flights was presumably not on the basis of objec- 
tive randomization^ It is entirely possible that the decision to use or 
not to use either of these kinds of equipment on each occasion had somo 
relation, conscious or unconscious, to the weather, the altitude, the 
personnel, or some other variable affecting the accuracy. 

The same qualifications apply to the average values of 7^1 for the 
10 teams shown in Table 3.4. Such scores are reliable indicators of 
differences in personal ability only if one of two conditions is satisfied 


TABLE 3.4 

Variation op Over-all AccuBAcy with Personnel 
(E.xccllcnt bombing is indicated by low values of 7’J) 


Teams 

1 

Number of flights 

^lo 

Average 7'q 


17 

184.834959 

10.87264 

2— W-S ' 

10 

73.105782 

1 7.31058 

3— n-R 

7 

62.168030 

1 8.88115 

4— \V-H ' 

3 

30.389824 

10.12994 

5— R-II 

11 

72.692080 

6.60837 

6— K-J 

1 » 

3.240875 

3.24088 

7— K-H 

8 

98.558949 

12.31987 

8— K-L 

4 

22.423547 

5 . G0589 

9— W-R 

3 

2S.6374D6 

9.54583 

TO— K-R 

1 

9.459515 

9.45952 

All lliglits 

65 

585.511003 

9 00786 


Either the assignment of the men mvist be suitably randomized, or an 
exhaustive knowledge of the other causes of variation must be at hand 
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and must show that these other causes exactly balanced as between 
the different teams. Since it is practically impossible to fulfill the second 
condition, objective randomization in advance is the only practical way 
of validating scores. 

Even under randomization, differences in scores prove nothing unless 
they are too great to be ascribed to chance. As between any two teams 
selected without reference to their scores in this bombing series, the 
effects of chance may be examined by means of the variance ratio, equal 
to the ratio of the mean values of To, with numbers of degrees of freedom 
equal to the numbers of flights of the two t.eAma multiplied by the number 
of degrees of freedom, here 8, for each flight. However, it would be an 
error to compare in this way two teams selected because their scores are 
the greatest and the least or because they occupy adjacent places when 
arranged in the order of the scores. Whether the 10 scores as a 
whole differ significantly from one another might be determined by the 
application of such a criterion as Bartlett's.* The tests might also be 
refined, if it should seem worth while, by a more complete segregation 
of the effects of personnel from those of each kind of equipment, hero 
represented by overlapping degrees of freedom, and of interactions. 
Wo are dealing here with generalizations of the ordinary analysis of vari- 
ance, generalizations whose fundamental theory has been developed 
only part of the way necessary for an efficient analysis of the ramifications* 
of bombing accuracy. 
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men may have the same height when measufed by inches, yet the finer the 
measurements the more seldom will they be identical, till finally the chance that 
lour men wiU have exactly the same height is infinitely small . If we had smaller 
grouping the zero values o! the staDclard deviation might be expected to increase, 
and a similar consideration will show that the smaller values of the standard 
deviation would also be likely to increase, such as 0.436, when 3 fall in one group 
and 1 in an adjacent group, or 0.50 when 2 fall in two adjacent groups. On the 
other .hand, when the individuals of the sample lie far apart, the argument of 
Sheppard’s correction will apply, the real value of the standard deviation being 
more likely to be smaller than that found owing to the frequency in any group 
being greater on the side nearer the mode. 

These two effects of grouping Avill tend to neutralise each other in their effect 
on the mean value of the standard deviation but both will increase the variability. 

Accordingly, we find that the mean value of the standard deviation is quite 
close to that calculated, Avhile in each case the variability is sensibly greater. 
The fit of the curve is not good, both for this reason and because the frequency is 
not evenly distributed owing to effects (2) and (3) of grouping. On the othei’ 
hand, the fit of the curve giving the frequency of 2 is very good, and as that is the 
only practical point the comparison may be considered satisfactory . 

The Statistical Research Group received various sets of data that 
exhibited curious statistical properties. In some instances it was found 
that these properties were attributable to the coarse rounding employed 
in recording the data. In at least one instance the peculiarities were 
attributable to the fact that a fraction of the data had been recorded with 
half the precision of the remainder, owing (in part) to intrinsic differences 
in the precisions of the two machines used to obtain the measurements. 
Occasionally the Group was asked to make recommendations with 
regard to the recording of data, since its investigations had shown that 
in many cases the trouble arose in connection Nvith recording the data 
and not in the actual reading of the scales. As a consequence of difficul- 
ties encountered in analysing coarsely rounded data and of requests for 
advice on rounding in general, a study of rounding was undertaken, 
principally from the view^point of its effect on the standard procedures 
of statistical analysis. The results of this study are summarized in this 
chapter. Much of the material presented hero can be found in the litera- 
ture of statistics, but it is widely scattered. 

2. ROUNDED NUMBERS AND SCALE READINGS 

Rounded numbers enter the practical man’s world through two differ- 
ent doorways. First, the measurements of a scientist or engineer are 
rounded num^rs, since all measuring equipment is of limited accuracy. 
Second, data are often recorded to less accuracy than is attainable with 
the available equipment, the accuracy preserx’cd being more easily 

tion mean, divided by the standard deviation of the sample, the latter defined as above 
(see Sec. 4.4 below), 
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attained and "adequate for the purposes at hand"; or they are rounded 
in computing, sometimes to simplify arithmetical calculations, as when 
0.40 is used in place of 51/128 (0.3984375 is exact), and sometinaes 
because it cannot be avoided, as when 3. 1410 is used in place of ir.* 

In the case t)f the computer’s reduction of exact numbers to rounded 
numbers in decimal form, assuming that he has rounded them correctly 
in accordance with the rule ^ven in the next section, it can be stated 
that each is accurate within unit in the last decimal place retained. In 
the case of the scientist’s or the engineer’s measurements this may not be 
true, and yet the last figures retained may contain worth-while informa- 
tion, in the sense that when the last figures are retained the data are 
more accurate than when the last figures are omitted entirely or are used 
as a basis for rounding the results to one less place. In such cases, if 
the measurements are all of comparable accuracy, there will exist a 
"unit” of measurement, with respect to which the uncertainty of a 
given measurement is H a unit. 

Consider, for example, the case of an experimenter taking "readings” 
on a scale ^vith graduations every in. He can read his determination 
to the nearest ^ in. directly and may then visually estimate it to the 
nearest He 1*^-, obtaining, say, a reading of SKe writes this out 

in decimal form it becomes 3.4375 in., and represents some number 
between 3.40G25 in. (3^H2 in.) and 3.41^75 in. in.), and this is 

accurate only to within ±0.03125 in. and not to within 0.00005 in., as the 
number of decimal places retained might suggest. He may decide, 
therefore, to report tlie value as 3.44, which is accurate only to within 
+0.02875 and —0.03375, but which will be closer to the true value than 
is 3.4, unless the true value lies between 3.40625 and 3.42000. When so 
reported, however, his readings 'vill not give a clear indication of their 
accuracy. If an unambiguous indication of their accuracy is important, 
he should report his readings in units of H in., in which event they will be 
accurate to within plus or minus 34 unit. 

3. THE ROUNDING RULE AND ITS PROPERTIES 

When a number expressed in the decimal system is to be rounded 
to a specific number of significant figures,! the rounding should always bo 
carried out in accordance with the following rule: 

• The mathematician has devised convenient symbols for certain vary practical 
quantities, such as the diagonal of a square of unit side (\/2) and the ratio of the 
circumfeience of a circle to its diameter (*•), which cannot be expressed exactly as 
common fractions or as decimal nxunbers with a finite number of decimals. By 
using the mathematician’s symbols for these quantities, the practical man can usually 
keep his algebraic manipulations simple, but sooner or later there comes a point at 
which a numerical answer is needed, and here it becomes necessary to replace jr 
(3.14159 26535 89793 23S4G-I-) ^'uth a common fraction, such as 355/113 (which is 
correct to 6 decimal places), or with a decimal approximation such as 3.141593. 

t A significant figure of a number (expressed in the decimal system of notation) 
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Rounding Rule: 

a. If the first digit to be dropped is kss than 5, the last digit retained 
shall be left unchanged. 

h. If the first digit to be dropped is greater than 5, or is a 5 followed 
by digits greater than 0, the last digit retained shall be increased by 1, 

c. If the first digit to be dropped is a 5 alone, or a 5 followed by C’s 
only, the last digit retwned shall be rounded to the nearest even number. 
Thus, rounding to 2 dedmal place's, 

T = 3. U1 593 yields 3 14 
e. = 2.718282 yields 2.72 
1/22 * 0.045455 yields 0.05 
1/200 ^ 0.005000 yields 0.00 
1/198^0.005051 yields 0.01 
10/2,247 i 0.004450 j-ields 0.00 

It is clear that to every ouraber that is to be “rounded down’' in 
accordance with part (a) of the rule there corresponds a number that is 
to be “rounded up” in accordance with part (h). Parts (o) and (5) thus 
establish a balance between rounding down and rounding up for all 
numbers other than those that arc e.vactly 6 in the first placo to bo 
dropped. Part (c) establishes a similar balance between rounding down 
and rounding up for numbers that are exactly 5 in the first place to bo 
dropped, by s{)ecifymg that the rounding shall be up w hen the preceding 
digit is 1, 3, 5, 7, and 9; down, when it is 0, 2, 4, 6, 8. Part (c) is arbitrary, 
since rounding to the nearest odd number would establish a balance in 
these cases equally well, being e<|uivalent to merely interchanging the 
words up and down in the preceding sentence. However, uniformity of 
procedure is important for checking, and consistency of publislied tables is 
desirable, so part (c), being well cstablislied, should lie arlhercil to. 

A question that arises naturally at this jKiint us: Will rejxjated applica- 
tions of the rule (dropping digits singly, or in pairs, or otherwise) alwaj's 
lead to the san>e result, when the rounding is stopped at a specified place, 
as a single rnunding to that place? The ans\\er, unfortunately, is No. 
The fiftli example in the list above is a case in point. If 0.0D505I is 
rounded to 2 decimal places in accordance with tire rule in almost any 
manner involving more than one step, tlie result is 0.00, which is “incor- 
rect.” The third example may be used to illustrate the fact that the 
number of places to which a number is ori^nally tabulated may affect 
the outcome of subsequent rounding: jr^2 ~ 0.0 45 45 45 45 ad injiniLum; 

ia any digit that eontributeato thcapeeificatioii of thcint^tiitude«f the rumber aside 
from sen'ing to locJite 1 he dnn'mal point. For example, 345 aaid 0.000345 f acli have 
three aignificant figures; 34.05 ajrd 31.50 (as distinct from 34.5} each have four 
gignificact figures; 34500 has 3, 4, or S accordinf as itaiftta3 3.45 X lOS 3.450 X 10®, 
or 3.4500 X 10®, respectively. 
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correct to 6 decimal places it equals 0,045 455, the value given in the 
table above; if this latter value is rounded to 5 decimals in accordance 
mth the rule, the result is 0.045 40; however 3>^2®Quals 0.045 45 correct to 
5 decimals, the result that will be obtained by rounding to 5 decimals 
when the value oiiginally tabulated is correct td'T decimals or more. 

It is clear from the foregoing that, when uii n-place table is prepared by 
rounding the entries given in an (n + A;)-place tabic, some of the entries 
may not be correct in the nth place. Thus, in a table of log., iV to 5 
decimal places, the 5-place value given for log, 1947 « 7.57404 50054 
will be incorrect in the fifth place if obtained by rounding from less than 
an 8-place table with entries correct in the eighth place. Final 5's can, 
however, be marked to show whether furllier rounding should be up 
or down; see, for example. Tables 1.1 and 1.5 of Chap. 1, in which each 
final 5 is italicized if rounding should not be in accordance with part (c) 
of the rule. 

It may be asked whether there exists a rounding nilo that will always 
lead to the same result at a specified place, irrespective of the numlier of 
applications of the rule employed in ri^unding to that place. A procedure 
suggested by Cayley* possesses this advantage. According to this 
procedure, the figure in the last place to be i-etained is not adjusted at 
all — which is equivalent to rounding down irrespective of the digits that 
follow — with the result that the numl)er recorded cither is exact or errs 
in defect. If, when a recorded number of this type is u.sed, a final 5 is 
affixed to it, then the error will lie between plus and minus 3^ unit in the 
last place recorded, as is the case when the number recorded is rounded 
in a single step from its exact value in accordance with the Rounding 
Rule. For example, ir would be rocordod to 4 decimals as 3.1415, and 
would be taken to be 3.14155 in further calculations. Whereas Cayley's 
procedure has the advantages that it is simple (since numbers are always 
rounded down), that it can be mechanized for purposes of machine 
computation, and that it yields an n-p!ace recorded number that is 
independent of the number of rounding steps involved in reaching it from 
the exact value, it has the disadvantage that it re(iuirGs the use of (a 1)- 
placc numbers in further computations in order to attain the same 
degree of accuracy that would be obtained by using n-piace numbers 
rounded in accordance with tlie Rounding Rule. 

4. EFFECTS OF ROUNDING ON STATISTICAL ANALYSES 
OF LARGE NUMBERS OF OBSERVATIONS 

4.1. Nature of the Effects 

Frequently a statistician analyzes measurnments recorded to several 
decimal places more than can possibly ha^'e any practical significance. 

• C.AYi,Er, letter to J. W. L. Glaisher. 
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The extra decimal places do not occasion any great concern, for nothing 
has been done that cannot be undone. Recording tlio extra digits and 
rounding the measurements are merely unnecessary nuisances. On the 
other hand, measurements are sometimes recorded to the nearest 5, 10, 
20, 50, or 100 units, or still more coarsely, when they could, and should, 
have been recorded to the nearest unit, or oven, more accurately. T hiis, if 
duplicate measurements taken under essentially the same conditions tend 
to differ on the average by about 50 units, research workers often record 
tlie measurements to the nearest 10 or 20 units; sometimes only to the 
nearest 50 units. If measurements taken under essentially the same 
conditions tend to be distributed approximately normally about a 
“true value “ with a standard deviation of tr, these roundings correspond 
to intervals with widths rougWy 0.23ff, 0.45 <t, and l.lc, respectively.* 
Statisticians, on the other hand, recommend that the width of the round- 
ing interval be less than one-third, or, better, less than one-fourth the 
standard deviation of random sampling, t 

Basically, the choice of the size of a rounding or grouping interval 
depends on, the answers to the following three questions:— 

a. If the observations xu xj, . . . , are to bo regarded as inde- 
pendent values of a random variable x, which, in the population from 
which the data are drawn, is distributed about a mean of m ''vith a stand- 
ard deviation er, then what is the effect of the rounding (grouping) on the 
sample estimates of n and <r, defined by 


N 



b. What is the effect of the rounding on confidence limits for n and o- 
based on x and s? 

c. What is the effect of the rounding on statistical tests of hypotheses 
about fi and <r based on x and s7 

In the present section, answers to these questions will be given for 
the case when the number of observations N is large. In Sec. 5 the case 
where N is small, perhaps only 2 or 3, is discus^d; the results given there 

* Tlie average difference between duplicate measurements is, under the assump- 
tions stated, 2 <t/ - yT ~ 1.12838<». If this average differenw- is 50, a grouping interval 
of 10 corresponds with 1.12838<»/5 * 0.226<r, and siraiJariy for a grouping interval 
of 20. 

t See, for example, Fishkr, Sialistic€d Methods, Sec. 13. 
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tlirow light on what -values of N maybe regarded as large and what values 
must he regarded as small. 

4.2. Sheppard’s Corrections 

In order to answer the first question, consider the relation between 
the kth. (population) moment 

4 = E(x^) = 2^p(x) dx (i = 1, 2, 3, .1, ■ ■ ■ ) (3) 

of a continuous random variable distributed according to the probability 
density function* p(x), and the Mh moment 

2 (A- = 1, 2, 3, 4, ■ ■ . ) (4) 

* 2 

of the histogram formed by grouping the values of x into classes of width 
u> with mid-points Xi, (t = 0, ±1, ±2, • • • ). The /i* are, by definition, 
tho moments (about the origin) of x in the population, in which x is a 
continuous variable. On the other hand, since it is not possible either 
to read or to record with perfect accuracy all values of a continuous 
variable, recorded values of x will generally be rounded values, any value 
of X between x< — (iy/2) and x< + (•ia/2) being recorded as Hence, in 
a sense, the are realistic moments of x and the pi are ideal moments. 

If, first, p(.t) can bo expanded in a Taylor scries throughout tlio range 
for which p{x) > 0, second, x*p<^">(x) is finite and continuous throughout 
this range (Ic — 1, 2, 3, 4, • • • *, ti = 2, 3, 4, • • • ), and third, p(x) 

and p^"^(t) (n = 1, 2, • • • ) vanish at the limits of this range, then 
the ffc and the ju* are related as follows: 

= Ml 

- M2 + J2 

Pa “ I Ml 

= + + ^ (5) 

^ ^ (2* + l)j Pk-2i 

»=y 

where CJ = /i:!/[r!(A: — r)!] for 0 < r- < A, and CJ = 0 for r > fc.f 

*Tliatis,forany valueofr, theintegral/'(c) = J p(xj rfz equals the probability 

that a; ia less than c, 0 < P(c) < I for all values of c, P( — « ) = 0, andP(-i- « ) =i. 

' t Sheppakd, “ Moat Probable Values of Frequency Constants.” The correspond- 
ing case of t-wo variables has been considereil by Baton, “Corrections for the 
Moments,” and of several variables by Wold, “Sheppard’s Correction Formulne.” 
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The three conditions regarding imply that it is not only con- 
tinuous over the range for w^iich p(x) > 0 but tapers off strongly to zero 
at the ends of this range; they thus exclude probability cuires with 
abrupt ends, such as a uniform distribution over — w/2 to +ra/2, ai^ 
{/-shaped or d-shaped cur\'es. The three conditions aie necessary and 
sufficient for the relations (5) to hold exactly. Relations analogous to 
(5), ^vith additional terms, have been obtained for cases excluded by the 
above assumptions. * • 

The relations (5) can be derived in a somewViat more general manner 
that shows that they arc valiil on the average whenever the moments 
involved exist, provided tliat tlie rouadlng lattice is imposed at random 
on the underlying distribution.! Suppose the x axis is first divided in a 
definite manner into an infinite number of class intervals of width 
where m is some integer greater than 1. Given a probability density 
function p(x), the histogram corresponding to this grouping of the values 
of X can always be determined from 

“ r u = 0, ±1. ±2, . . . ) (0) 

where xj is the mid-point of the jth subdiv^ion, since the integrals 
involved will always exist when p(x) is a probability density function, 
'fhe momenta about the origin of this basic histogram, (li', say, can be 
<letermined from the summation analogous to (4), so far as they exist 
(that is, arc finite). Corresponding to the bash histogram determined 
by (fi), m new histograms can be formed by combining the successive 
subclasses of width w/m into subclasses of width u‘, the intervals con- 
taining xo, Xi, , Xm-i l)eing combined hi one instance, the intervals 
containing Xi, z^, . . . , jCm Imng combined in the next instance, and 
so forth. Corresponding to each of these histograms, moments about tho 
origin, v5,(s), s = 1, 2, • • • , m, can Y>e determined from summations 
analogous to (4), so far as they exist. Let vjt denote the average of the 
values of s = 1, 2, • • • , w, then the and the arc related as 

follows, in so far as they exist: 



• See papers by Eldcrton, Pairman and Pearson, Pcarse, nt\d Pearaon listed in 
Sec. 7 below. 

t See the papers by Abematby, Craig, and Carver listed in Sec. 7. 
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and so forth. Letting m the right-hand sides of these equations 

tend to the corresponding expressions inequations (5), since m* 
m . On the other hand, the retain their meanings as average 
values of the v*. Accordingly, whatever the nature of the distribution 
oUx, equations ^5) hold on the aoerage, that is, they give the average 
relationships betn^en the and the uL provided these are finite, for an 
infinite series of trials in which a rounding lattice composed of sections of 
^ridth w is imposed at random on the underlying probability distribution. 

The results given above all refer to moments about a fixed point 
taken as the origin, and the values of the moments involved will depend 
upon the choice of the origin. Thus, if x denotes temperature and is 
measured in degrees Fahrenheit, the values of the fii and f'k nill be differ- 
ent from those obtained when x is measured in degrees centigrade. The 
results obtained vdW be the same, however, if the origin is chosen at 
the mean of the distribution of x. Dropping the primes to signify 
moments about the mean of x, relations (5) correspond with. 

r: = « 0 

^2 ( 8 ) 

J*! — ■ 

, , W* 

V. = + 2- • « + 80 


and so forth. 

Comparison of the second equation of (8) with (22) shows that the 
variance (second moment about the mean) of a rounded value of x, which 
may be denoted by Tr for convenience, equals the variance of x, namely 
plus a variance w^/\2, which equals the variance of a rounding error 
which is distributed uniformly between —wf2 and -b v)/2. This suggests 
that we may nTite 

Xk = X + € (9) 

where Xr denotes a value of x rounded to within ± and e is a random 
variable independently distributed with uniform probability density 
between — •u?/2 and -l-tc/2. That the representation (9) is strictly valid 
under the three conditions stated above, and that it is valid on the average, 
in the above sense, under any conditions for which the moments exist, 
has been demonstrated rigorously.* 

Since it is usually desired to determine the /z* from the n, equations 
(8) are customarily solved for the ftk in terms of the y* and powers of w, 
and the relations given as 

• See papers by Craig and by lAngdon and Ore, listed in Sec. 7. 
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( 10 ) 

to- , 7w* 
and so forth.* 

These adjustments of the vt to obtain the are customarily called 
Sheppard’s corrections for grouping. As has been indicated above, they 
are valid as average adjustments whenever the moments involved exist, 
provided that the rounding lattice is imposed at random on the' under- 
lying distribution. This latter provision means, for example, that when 
values of a variable that can take only nonnegative values are to be 
rounded, zero shall not inevitably be adopted as the lower extremity of 
the lowest class — indeed, the mid-point of the lowest class may turn 
out to be a small negative number. If the rounding lattice is not imposed 
at random when Sheppard’s original assumptions are not fulfilled, 
then the foregoing adjustments may be wildly wrong and may even 
adjust in the wrong <lirection.t 

4.3. Comparison of the Distribution of the Mean of N Rounded Observa- 
tions and the Distribution of the Mean of N Unrounded Obser- 
vations, When N Is Large 

Sheppard's corrections make possible a concise comparison of the 
distribution of the meari of N rntinded observations and the distribution 
of the mean of N unrounded observations, when N is large. Continuing 
the notation adopted in connection with (9), let 

= i f ( 11 ) 

»=•! 

where is the rounded value of Xi, the fth of N independent values of a 
random variable x, corresponding to a rounding lattice with classes of 

* The corresponding relations for [tf, to jua are given in Rietz, Handbook, p, 94. 
They can be obtained by letting m — » <« in the expressiong for ps to given by Craig. 
Letting and L* (fc = 1, 2, • • • ') denote the semi-mvariants of the unrounded 
variable x and the rounded variable xg, respectively, the corresponding relations 
become simply 

him =* Lim + ( — 2^ 

^2»+l = Lson-l 

where ia the mth Bernoulli number. Thus, X* = X»4 + w*/120, Xg = L# — «i)®/252, 
Xg = Ls + w^/2i0, and so forth. For further details, see the papers by Craig, 
Langdon and Ore, and Wold. 

t The reader who wishes to delve further into the mathematical background of 
Sheppard’s corrections is urged to read EendaU’s paper. 


Ml = *'1 = 0 
w- 

M* = ^ 
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width w (located at random on the x axis, if Sheppard's assumptions are- 
not fulfilled) . Furthermore, let 

the mean of x in the population — 

the variance of % in the population = tr| = (12) 

the hth. moment of x aboutits population mean = 

(k =■ 1, 2, - ■ . ) 

and let 

W = a' (13) 

Table i.l presents a comparison of the distribution of xa in regard to 
mean, variance, skewness, and kurtosis with the distribution of x and 
with a normal distribution of mean fi[ and variance a-. 

From a study of Table 4.1 it is apparent that 

(1) X and xr are each unbiased estimators of the population mean of 

X. 

(2) The variance of xr is (1 + rt'/12) times the variance of x. 

(3) The skewness (yi = + \/Jl of Pearson’s notation) of the dis- 
tribution of Xr never exceeds that of the distribution of x. 

(4) The kurtosis (y 2 = ^2 — 3 of Pearson’s notation) of the distribu- 
tion of xb is always less than that of the distribution of x. 

(5) When N is large, £ and xk arc appro.ximately normally distributed 
about the population mean of x, mi;*- 

The case in which the ungrouped variable x is normally distributed 
is of special interest. In this case x is likewise normally distributed, 
whereas the distribution of xr is symmetric but has slightly less kurtosis 
than a normal distribution, the deficiency being (a*/120N)/(l -f- a^/12)^. 
From the Gram-Charlier series for the “generalized normal curve, 
it is seen that this deficiency in kurtosis implies that the distri- 
bution of £r has slightly less area in the “central region,” say, between 
±0.75crig, slightly less also in the “tails,” say, beyond ±2. 3^5^, and 
slightly more between these points. For any practical rounding, say, 
a = w/cr < 1, this effect will surely be negligible. R. A. Fisher has 
shown! that the maximum likelihood estimate A of mI:* from N inde- 
pendent rounded values Xr of a normally distributed variable x has a 
variance of (1 + a^/12 — aV2,880 4- ■ ■ ■ ') - The loss of precision 

when Xr is used instead of ^ is, therefore, only aV2,880, which is clearly 
negligible for any practical reminding. 

In conclusion 

a. Xr is an unbiased estimator of the population mean of x, 
whatever the value oF W. 

h. AVhen N is large and the values of <r* and w are known, so that 
c-2-^ = (<72 ^ w^/l2)/N can be evaluated, confidence limits for, and 

* See, for instance, Rietz, Hartdboolc, p., 1J4. 
t Fisher, “Mathematical Foundations,” p 362. 
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statistical tests of hypotheses regarding the value of a'i:* carried out 
with {xr regarded as a normal deviate will be approximately 

correct — provided the true distribution of x has ‘‘high order contact” 
(that is, Sheppard’s assumptions are valid), or the rounding lattice is 
located at random with respect to the admissible values of r, or both. 

TABLE 4.1 

CoMPAsrsoN OP THE Mean, Varfance, Skewness, and Kuhtosis of the 
Distribution of the Average op N Independent Rounded Values of a Random 
Variable with the Corresponding Characteristics op the Distribution of the 
Unrounded Variable and of a Normal (Gaussian) Distribution When the 
Width of the Rounding In'perval Is' a Standard Deviation Units (w = a ■ v) 




Distribution 


Characteristic 

Unrounded 
variable, x 

1 

Average of K 
rounded values, Sr 

Xorina) 


f ^ 

i 

f 






! 





O+W'’ 




N 



Tiu «* — T 
<^1 

yi:s 

0 


V'-f-S)' 



a* 


f 

yo- - 3 

1 120 

0 





4.4. Comparison of the Distribution of s- for Rounded and Unrounded 
Observations, When the Number of Observations Is Large 
Let 



»=i 


where XRi (f = 1, 2, * • • , N) and xa are as in (11). In Table 4.2 the 
mean of and the ratio of the variance of to the square of its mean 
are compared with the mean and corresponding ratio for under two 
sets of conditions: first, when x has any distribution for which the 
first four moments exist; second, when x is normally distributed. 
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It is evident from a study of Table 4.2 that the ratio 
(variance of s*)/(mean of 

is always less in the case of than in the case of s|. The difference 
is slight, however, and for any reasonable rounding, say, a ~ w/cr < 1, 
will generally be negligible. Therefore 

(1) When N is large, (N — + w-/l2) and (N — l)sl/ol will 

be distributed as x* with N — 1 degrees of freedom to about the same 
order of approximation. 

TABLE 4.2 

The Mea>7 op si and of the Ratio of the Variance of si to the Square of the 
Mean Compared with tuk Corresponding Quantities for s*, When the 
Distribution op x Is Arbitr.\ry* and When the Distribution of x Is Normal 



* Subject to the reatriciion thnt the first four moments of x about its Ropuktion mean exist. 


(2) The quantity — U'yi2is an unbiased estimator of the variance 
of X in the population <r|, whatever the value of N, provided the distribu- 
tion of X has high order contact (that is, Sheppard’s three assumptions, 
stated in Sec. 4.2, are fulfilled), or the rounding lattice is located at 
random with respect to the admissible values of x, or both.* 

It may be well to point out here that the ratio 

(N ~ iKsl^ - w^/l2)/cl 

should not be used as a substitute for the ratio given in (1) unless a = w/o 
is quite small, since the variance of this ratio exceeds the variance of the 
ratio given in (1) by a factor of (1 + a-/ 12)-, which will generally render 

• When N is small, the mean and variance/(mean)* relations shown in Table 4.2 
are still valid, hut the discontinuities of the dist.ribution of are such that graduation 
of the distribution of by a continuous distribution is virtually impossible (see 
Sec. 5.1). 

Kendall has remarked that (2) gives the correct estimator of a® if the rounding of 
the values of x is determined before the sample is drawn. If, on the other hand, the 
observations xi, 12 , . . . , xn are drawn first and then rounded, he suggests that 
s|^ — w^/[12(N ~ 1)1 be used to estimate "When N is large the difference is 
clearly negligible from a practical standpoint but is of some theoretical interest. 
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the approximation less accurate. If the adjusted numerator and the 
denominator are used, then the variance of the resulting ratio 

will be the same as the variance of the ratio given in (1), but the mean 
will be deficient by a factor of 1/(1 + aVl2). If is used in the 
numerator and in the denominator, the mean will be excessive by a 
factor of (1 + 0 ^/ 12 ) and the variance by a factor of (1 + aVi2)-. 
Consequently, 

(3) Determinations of confidence limits for, and statistical tests of 
hypotheses regarding, the value of a\ should be based on sl^ as implied 
by (1) and will be valid to the extent that the conditions and approxima- 
tions thereof obtain. 

In conclusion, it should be remarked that the foregoing discussion can 
be carried over to the ease where has been obtained from an analysis 
of variance of values of x that hav’e been rounded to within ±w/2 and 
has n degrees of freedom. The only change required is replacement of 
iV — 1 by n throughout. 


4.6. Effect of Rounding on the Distribution of Student’s t 
Let 

VN(i~ mU) 

and 


(15) 


( 10 ) 

where £ and xr are as in (1) and (11), s* and are as in (2) and (14), 
n[.g is the mean, value of x in the population, and N is the number of 
independent values of x (or of xn) in the sample. 

When the N independent observations involved are from a normal 
distributi on, the distribution of t, is known as “StudonVs t di stributi on/* in 
recognition of the fact that the distribution of » = t/\^N ~~ 1 under 
these conditions was first given by Student in the epochal paper from 
which the quotation in Sec. 1 of this chapter is taken. In his derivation, 
Student utilized the independence of x and s when computed from 
independent observations from a normal population, although he himself 
merely established the fact that the product moment coefficients of 
correlation between x and .s, and between x* and are zero under these 
conditions. Independence of x and s is actually a necessary condition. 
A rigorous proof of their independence in random samples from a normal 
population was communicated to Student by R. A. Fisher in correspond- 
ence prior to the First World War; this first saw light, only incidentally, 
as a preliminary step in> Fisher’s paper, published in 1915, on the exact 
sampling distribution of the correlation coefficient.* The first complete 

* Fisher, '' Distribution of the Correlation Coefficieot.” 
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derivation of Student’s distribution was given, in terms of i, by Fisher 
in 1926,* * * § although he had given a more general definition of i two years 
earlier.! 

As Student pointed out in the passage quoted in Sec. 1 of this chapter, 
there is a correlation between the sample mean and the sample standard 
deviation in random samples of rounded observations, resulting from the 
rounding, so that xr and will not be independently distributed even 
when X and s* are independent. Nevertheless, Student’s experimental 
results suggest that the distribution of tx^ will closely appro.ximate that 
of tx when N is large enough to render negligible the discontinuities of 
the distribution of That this is so is evident from a study of the 

first four moments of for the ease of x having an arbitrary distribution 
subject only to the condition that its first four moments exist. The 
first four moments of can be evaluated readily, under this assumption 
regarding x, from the expressions for the first four moments of i in terms 
of the semi-invariants of x, given by Geary.J The first four moments of 
are given in Table 4.3, where they arc compared with the first four 
moments of Student's I distribution, that is, the moments of when x 
is normally distributed.! 

It is evident from a study of Table 4.3 that, to terms of order 1/iV, 
rounding affects only the fourth moment, and that the effect is clearly 
negligible in the case of samples from a normal population ( 71 :, = 0 and 
7 a:x =* 0) for any reasonable rounding, say, a “ w/e <1. It can be 
seen from a study of Geary’s more extensive formulas that, when the 
distribution of x is symmetrica} hut not necessariJy normal, the first 
and third moments of are zero through terms in 1 /N* at least and the 
variance of tx^ has its normal value through the terms in 1/iV. Indeed, 
when X is normally distributed, the variance of has its normal value 
through terms in 1/iV^ also. Therefore, it may be stated that 

When N is sufficiently large and w is sufficiently small to render 
the discontinuities of the distribution of negligible, the distribution of 
and tx will follow the standard I distribution to about the same order 
of approximation, provided the distribution of x has high order contact, 
or the rounding lattice is located at random with respect to the admissible 
values of x, or both. 

• Fisher, “Applications of Sludfint’s Distrihutinn.” 

f Fisher, “Error Function 0/ Well-ICnott'ii Statistics,” 

t Geary, “Distribution of Student’s llatio.” 

§ The moments of arc given to terms of order l/N} that is, terms in the and 
higher powers of 1/iV have been neglected. Geary’s general expressions for the first 
four moments are correct to terms of order 1/A*. The terms of order \/N^^ and 
1/A* for tz can be evaluated with the aid of the semi-invariants of xr given in the 
footnote to expressions (10). above. 
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It should be noted that and not its adjusted value given in 
Paragraph (2) of Sec. 4.4, is to be used in the denominator of tx . If the 
adjusted value is used, giving ' 




\/N (jCs — m'i:J 



(17) 


then, since it is elenr that signihcant values of will arise 

too frequently. Furthermore, when $1^ is less than w^/l2, the value of 
will be imaginary, and in such cases some convention regarding the 
value of to be recorded will be needed. In other words, as Fisher 
has stated, “These [Sheppard’s] adjustments should be used for purposes 
of estimation, but not usually for tests of significance.’'* 

The foregoing discussion carries over to the case where sj,, has been 
obtained by an analysis of variance, or otherwise, from values of x 
rounded to within ±u)/2 and has n degree of freedom, provided the 
situation is such that x and sj may be regarded as independently dis- 
tributed. The only change required is to replace iV — 1 by n throughout. 


6. EFFECTS OF ROUNDING ON STATISTICAL ANALYSES OF 
SMALL NUMBERS OF OBSERVATIONS FROM A NORMAL ROPULATION 

6.1. Introduction 

Although the result.s obtained abov^are independent of the value of 
N, the discussion up to this point has been concerned mainly with 
cases involving a large number of observations. An exception is the 
quotation from Student in See. 1, which discusses in detail the effects of a 
coarse vouadinQ on samples of 4 from a nearly normal population. From 
thi.s passage it is clear that in the case of small samples the discontinuities 
of the distributions of and are the most serious effect of the round- 
ing. For a fixed N, the discontinuities of the distributions of Xg and 
may be expected to increase in number (in any finite interval) but to 
decrease in seriousness as the width of the rounding interval w decreases, 
and, for a fixed w, to increase in number but decrease in seriousness as 
N increases; hence, it is clear that largeness of N has meaning only in 
conjunction with smallness of w. 


6.2. Exact Distribution^ of in Samples of 2 and 3 from a Normal 
Population 

I 

5.2.1. Illustrative Distributions. — lu order to throw light on the 
joint effect of ic and N" on the distribution of in small samples from a 

PisuEa, Slalistical Melhods, Sec. D of Appendix to Chap. III. 
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normal population, exact di.stributioiis of in samples of 2 from a normal 
population have been computed for w = tr, o-/2, and cr/4. These are 
portrayed in* Figs. 4.1, 4.2, and 4.3, where they are compared with 



sV<r,« I 

t'lQ, 4.1.— Distribution of for samples of 2 from a normal population when the 
width of the rounding interval is one standard deviation, and correspoading coatinuous 
distributions of sj and = (t3/12)sS. 

the distribution of si, which is distributed as xV* for 1 degree of freedom. 
In Fig. 4.1 the distribution of , 

( 18 ) 

is shown also, in view of (1) in Sec. 4.4. 
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The large steps in the distributions of sl^ showTi in these figures 
emphasize the discontinuous character of these distributions. It 
follows from (1) of Sec. 4.4 that when N is large the distribution of s' may 
be expected to graduate the distribution of more closely than will 



0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 

Fia. 4.2. — Distribution of for samples of 2 from a normal population when the 
width of the rounding interval is one-half standard deviation, and corresponding con- 
tinuous distribution of 

the distribution of s®. From Fig. 4.1 it is clear that the improvement is 
negligible when N = 2 and w = v. Furthermore, it is clearly impossible 
to find smooth curves that will approximate these step functions closely 
at all points. In other words, the probability of si, or 5* , equaling or 
exceeding a value u will approximate closely the probability of 
equaling or exceeding u only for certain values of u, principally tho.se that 
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are near a point of intersection of the distribution curve of or «'*, 
with tlie horizontai portion of a step in the distribution of 

Figure 4.4 compares the distribution of in samples of 3 from a 
normal population when w = a with the distribution of si, which is now 



a 1 2 3 4 5 6 7 8 9 10 n 12 13 14 

Fig. 4.3. — Distribution of for ssmpJes of 2 from s normal population when the 
width of the rounding interval is ona-quartcr standard! deviation, and rone.Hpo'nding 
continuous diatribution of «!. 

distributed as xV’*/2 for 2 degrees of freedom. Comparison of Fig. 4.4 
with Fig. 4.1 shows that increasing AT from 2 to 3, with w fixed, has 
decreased the magnitudes of the steps, but not markedly. 

6.2.2. Effect of the Position of the Pounding Lattice. — Before attempt- 
ing to answer the question of how large N needs to be for a given value 
of v>, and vice versa, in order that the approximation given in Paragraph 
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(1) of Sec. 4.4 can be used wth confidence, it will be well to digress 
briefly on the effect of the position of the rounding lattice on the distri- 
bution of when N and w are fixed. 

N=3, w=o" 



Fio. 4.1. — Distribution of for samplos of 3 from a normal population when the 
wititli of the rounding interval is one standard deviation, and corresponding continuous 
distribution of «1. 


Tables 4.4 to 4.6 give to 7 decimal places the exact distributions of 
sl^ for N = 2 and w = <r, (r/2, and <r/4, respectively, corresponding to two 
positions of the rounding lattice that are a half period* apart, when the 
•J/Ct denote the value of x at the mid-point of the tth interval, 

5i — w/2 < X < £, + w/2 (» = 0, ±1, ±2, • • • , ± 
corresponding to a given location of the rounding lattice. Writing 
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sampling is from a normal population. These two positions have been 
chosen as follows: 

Position I: The mean of x in the population coincides with the 
boundary between two of the rounding intervals. In the notation 
of the footnote, this means that if the mean of x in the population 
is chosen as the origin, so that = 0, then 9 ~ —{2i — l)7r, 
where i is some positive or negative integer, or zero. 

TABLE 4.4 

Exact Distbibution.s ofj*^ = (xR^ — x&.p /2 foh the Extreme Positions of the 
Rounding Lattice When the Width of the Rounding Interval Is One 
Standard Deviation and Xi and Xi Are Independent Observations 
iFBoM A Normal Population 

W = 2, ic = <Tt) 


w* 

Probability that -= > w 


Position I 

Position 11 

0 

1.0000 000 

1.0000 000 

H 

0.7291 077 

0.7200 858 

3 

0 2987 606 

1 0.2987 802 

“'2 

0.0332 659 

0 0832 009 

8 

0.0152 891 

0.0152 903 

2?2 i 

0.0018 126 

0.0018 124 

18 

0.0001 368 

0.0001 368 


0.0000 06o 

0.0000 065 

32 

0.0000 002 

0.0000 002 

Over 32 

0.0000 000 

0.0000 000 

1 

1 0833 332 

1.0833 3.34 


2.3430 509 ' 

3.3430 491 


* The values of u shown include every posable value up to 32. 


Position II : The mean of x in the population coincides with 
the mid-point of a rounding interval. Thus 9 ~ where i is 

some positive or negative integer, or zero. 


B may be used to define the location of the rounding lattice. Thus 0 = 0 when the 
mid-point of the 0th interval is at the origin (x = 0), and 6 — ir when the lower 
boundary of the 0th interval is at the origin. Clearly, the rounding ia the same for 
0 = -fi and 0 = iP ± 2kir, where A; is an integer. 
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Table 4. 7 gives to fi decimal places the exact distributions of for 
iV = 3 and w = <t, corresponding to these two positions of the rounding 
lattice, when the sampling is from a normal distribution. 

TABLE 4.5 

Exact Di.sTRiBtJTiONfi of = (xri — a;R,)*/2 for the Extreme Positions of the 
Rounding Lattice When the Width op the Rounding Interval Is 
One-half Standard Deviation and xi and xi Are Independent 
Obsewvations from a Normal Population 




u* 

gi 

Probability that « 

<r* 

u* 

gt 

Probability that —z>u 

Poaition I 

Position 11 

Position I 

Poaition II 

0 

l.OOOQ COO 

1.0000 000 


0 0000 no 

0.0000 no 


0.8604 037 

0.8604 037 


0 0000 021 

0.0000 021 

H 

0.6977 89S 

0.5977 898 


0.0000 004 

0.0000 004 

% 

0.3792 359 

0.3792 360 

32 

0.0000 001 

0.0000 001 

2 

0.2183 109 

0.2183 no 

Over 32 

0.0000 000 

0.0000 000 


0.1134 753 

0.1134 754 




H 

0.0530 515 

0.0530 515 





0.0222 398 

0.0222 398 




8 

0 0083 396 

O.OOS3 396 





0.0027 919 

0.0027 919 

V{sl^) ' 

2.0839 751 

2.0839 755 


O.OOOS 331 

0. 0008 331 

1 




0.0002 213 

0.0002 213 




IS 

0.0000 523 

0.0000 523 

- 




* The values of u shown iaclude every poesible value up to 3‘J. 


The probabilities given in these tables were evaluated with the aid of a 
15-place table of the probabilities for normal deviates,* and are believed 
to be correct to ^vithin 1 unit in the last place shown. The calculations 
were carried to 10 decimals or more at all stages and were carefully 
checked. The individual probabilities obtained, when rounded to the 
number of places shown, sum to unity within + 1 in the last place shown. 

Prom these tables, and the fact that Petitions I and II represent 
opposite extremes in their effects on the follo'vnng conclusions may be 
drawn : 

(1) When iV = 2, the probability that sljir- equals or exceeds u 
is unaffected to 4 decimal places by the position of the rounding lattice 
if ly = (t; to 7 decimal places, in general, if w < (t/2. 

(2) When N = 3, the probabihty that equals or exceeds u 


Mathematical Tables Project, Tables of Prdbahilily Functions. 
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is unaffected by the position of the rounding lattice to 3 decimals if 
w = a. 

(3) The effect of the position of the rounding lattice on the distribu- 
tion of appears to increase with the number of observations involved, 
that is, with N. 


TABLE 4.6 

Exact Distributions or =» Or«i ~ ®«i)V2 Fon the Extreme Positions op the 
Rounding Lattice When the Width of the Rounding Interval Is 
One-quarter Standard Deviation and xi and Xt Are Independent 
Observation.^ pn^>M a NonAfAi. Popui.ation 




14 * 

Probability that -^ > u 

u* 

gt 

Probability that ^ ^ “ 

Position I 

Position 11 

Position I 

Position 11 

0 


1.0000 000 



0.0020 043 

Ha 

0.929fi .‘i94 

0.9290 



0.0010 902 

H 

0.7911 480 

0.7911 481 

2 H 


0.0005 759 

Hi 

0.0589 474 

0.6589 474 

**H2 


0.0002 954 

H 

0.5360 322 

0.5366 322 



0.0001 471 


0,4269 273 

0.4269 273 



0.0000 711 

H 

0.3315 445 

0.3315 446 

18 


0 0000 333 


0.2511 525 

0.2511 525 



0.0000 151 

2 

0.1854 693 

0.1854 693 



0.0000 066 


0.1334 404 


’ 2^2 


0.0000 028 








0.0637 758 


*•*^2 



H 

0.0423 2G9 

0.0423 269 

22 H 




0.0273 253 

0.0273 253 

Over 225^ 




0.0171 541 

0.0171 541 

Eisl ) 









s 

0.0062 099 





28^2 

0.0035 793 


















* The values of -u efaowa include every possible value up tg 225/8. 


The mean and variance of for each of the situations considered 
in Tables 4.4 to 4.7 are given in these tables. These values are brought 
together in Table 4.S, where they are compared with the coTTesponding 
average values computed from the formulas of Table 4.2. When 
is based on N independent (rounded) observations from a normal dis- 
tribution, then the formula of Table 4.2 for the average variance of 
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becomes 

average variance of sj, = ^1 + .^^^1 - ) (19) 

where a. — w/c*. Equation (19) gives the average value of the variance 
of 5*^ in a series of repeated trials in each of which JV independent 

TABLE 4.7 
3 

Exact DtSTHiBOTioNfi OP ^ — XR)*i2 Foa the Extkeaie Po-sirroxs of 

*=•1 

THE Bounding Lattice When the Width of the Rounding Interval Is 
One Standard Deviation and xt , Xs , and xj Abe Independent 
Ob.sehvaiions from a Normal PoruLATroN 
(iV = 3, nj = tf,) 


1 

u* 1 

Probability that > u 

1 

«• 1 

gi 

Probability that -^ > u 

Position I 

Position 11 

Position I ' 

Position II 

0 

\ ,000 000 

t .000 000 

® 1 

0.000 401 1 

0.000 401 

H 

0.915 415 

1 0.915 J&6 

1 

0.000 278 1 

0.000 278 

1 

0,541 Idl 

1 0.54i 514 


0.000 0D8 ' 

0.000 098 


0 339 213 

: 0.338 898 

12 

0.000 027 

0.000 027 

H 

0.190 327 

1 0.190 245 


0.000 019 1 

0.000 019 

3 

0.071 985 

' 0.072 096 

13 

0.000 008 

0.000 008 

4 

0.040 097 

1 0.040 103 


0.000 002 1 

0.000 002 


0,027 447 

1 0.027 411 

16 

0.000 001 1 

0.000 001 


0,008 814 

0 008 808 

Over IG 

0,000 000 ' 

0.000 000 


0.005 122 

1 0.005 122 

E(sl ) 



7 

0.002 200 

1 0.002 206 


1 .083 330 1 

1 .083 336 


0,000 029 

0.000 629 


I 





V{sl) 






1 

1.170 804 

1.170 831 


* The values o ! u shown include every pee»j1>le vsluo up to 14. 


observations are drawn at random from a normal distribution, the posi- 
tion of the rounding lattice being determined at random independently 
for each trial. Since the average value of the mean of sl^ is unaffected 
by the nature of the distribution of x, its value is given by the formula 
of Table 4.2 in any case. From Table 4.8 it is seen that 

* When iV is large so that (iV — J)/iV = 1, formula (19) agrees through the term 
in a* with the expression given bv R. A. Fisher, “ Matliomatical Foundations/’ p. 362, 
S 

for the variance of ^ computed from iV independent rounded observa- 

» = 1 

tions from a normal population. 
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(1) When is 2 or 3 and w < tr, the mean values of for Position I 
and Position II of the lattice agree with each other and with their 
theoretical average values, to 5 decimal places or more. 

(2) When is 2 or 3 and ta = <r, the variances of sl^ for Position I 
and Position II of the lattice agree with each other and with their theo- 
retical average values to 2 decimal places or more; when w < 0 / 2 , to 
3 decimal places or more. 


TABLE 4.8 

Comparison of Actual Values op the Mean and Variance op with the 

Values Implied by the Formulas of Table 4.2 When the Width of the Rounding 
Interval Is One Standard Deviation (and Less) and Is Based on Two or 
Three Independent Observations from k Normal, Distribution 


Number of 
observations, 

Width of 
rounding 
interval , 
ff units 

Lattice 

position* 

Mean value of 

Variance of 

Actual 

By form iiJa 

Actual 

By formula 

* 

2 

1 

I 


1.0833 338 

2.3430 509 

2.8423 322 


1 

II 




2.3423 322 



i 

VlwnSTR 

1.0208 333 

2.0839 751 

2. 0839 300 



II 

1 .0308 314 

1.0208 333 

2.0839 755 

2.0839 300 


34 

1 




2.0208 711 



II 

1.0052 058 


2.0207 8C9 

2 0208 711 

3 


r 

1.083 330 

1.083 338 

1.170 804 

1.170 351 



II 

1.083 336 

1.083 333 

1.170 831 

1.170 361 


* For t.he Pbeiiion 1 And Posiiion 11, »ee Section d.2.2. 


Fisher* has studied the effect of the position of the rounding interval 
on the mean values of Xr and in samples from a normal distribution 
using an analytical approach based on the periodic character of such 
effects noted in the first footnote of this section. He has calculated 
that the bias of xr due to the position of a rounding lattice with intervals 
one standard deviation wide will be less than one-tenth the standard error 
of Xr for values of N less than 1.379 X 10 ‘*. For s| the corresponding 
value of N is 1.75 X 10^^; for the variance of it is 1.34 X 10^^ 

From (1) and (2) above and from Fisher’s analysis, wo conclude that 

(3) The effect of the position of the rounding lattice on the mean and 
variance of Xr and in samples from a normal distribution is minute 
in comparison to the average effects of the rounding. 

(4) In small samples (from a normal distribution at least), so far as 
the approximation of the distributions of Xr and by continuous 
distributions is concerned, the discontinuities of the distributions of xr 

• Fisher, "Mathematical Foundations,” pp. 318-321. 
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and , caused by the rounding, are far more serious than the effects 
of the position of the rounding lattice. 

6.3. Combinations of Sample Sizes and Rounding-interval Widths for 
Which the Actual Distribution of Can Be Approximated Satis- 
factorily by a Continuous Distribution, When the Sampling Is From 
a Normal Population 

We have not found a rigorous answer to the question of how large 
the sample size N needs to be for a given rounding-interval width w and 
how small w needs to be for a given value of A' before the approxima- 
tion given in Paragraph (1) of Sec. 4.4 will adequately represent the dis- 
tribution of for most practical purposes. Since the discontinuities of 
the distribution of are the principal source of the difficulties encoun- 
tered in attempting to represent the actual distribution of s'i^ by a con- 
tinuous distribution when AT is small and w is comparatively large, it is 
clear that an answer depends on finding the combinations of N and w for 
which the discontinuities of the distribution of over any given interval 
are sufficiently numerous and the steps sufficiently small to render them 
negligible. 

TABLE 4.0 

Probability That a Zero Value op 4* Will Be Obtained When Is Based on 

N iNbEPENDENT RoUNDED OBSERVATIONS FROM A NoBMaL DISTRIBUTION 


Number of 
observations, N 

Width of rounding interval in ^ units (o 

- w/a) 

1 

1 ^ 

H 

H 

2 

0.271 

0.1390 

0.0703 

0.0302 

3 

0.085 

0.0225 

0.0057 

0.0014 

4 

0.028 

0.0038 

0,0005- 

0.0001- 

5 

0.009 

0.0007 ' 



6 

0.003 

0.0001+ 



7 

O.OOl* 





The combinations of N and w for which the discontinuities of the 
distribution of are negligible when the sampling is from a normal 
population could be determined by preparing, for wide ranges of values 
of N and w, tables of the actual distribution of analogous to Tables 
4,4 to 4.7. The arithmetical labor of the calculations involved in the 
preparation of such tables is so enormous, however, that it seems ad\dsable 
to devise some rule of thumb, which is intuitively sound, as a substitute 
for rigorous ans\vera until the latter become available. Accordingly, 
we propose that the probability of equaling zero for given values of N 
and w, when the sampling is from a normal population, be used as a basis 
for deciding whether a given pair of values of N and w is satisfactory. To 
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be more explicit, we propose that P{sj^ = 0}iV,w’} < 0.001, evaluated 
on the assumption that the sampling is from a normal population, be 
adopted as a tentative definition of the combinations of values of N 
and w for wliich the approximation given in (1) of Sec. 4.4 provides a 
satisfactory approximation to^ the distribution of for practical 
purpose.?. 

Values of P\sl^ ~ 0|jV,w}, for sampling from a normal population, 
ate given in Table 4.9 for various combinations of values of N and w, 
the latter being expressed in units of the population standard deviation. 
It appears from this table that satisfactory combinations, where a = le/cr, 
are 


a 

< 

Hoo, 

N 

> 

2 (by extrapolation) 

a 

< 

Mo. 

N 

> 

3 

a 

< 

M. 

N 

> 

4 (20) 

a 

< 

M. 

N 

> 

5 

a 

< 

H. 

N 

> 

6 

a 

< 

h 

N 

> 

7 


The fact that the combinations (20) represent a somewhat arbitrary 
definition of the circumstances under which (1 ) and (3) of Sec. 4.4 may be 
expected to yield satisfactory results in practical work should nqt bo lost 
sight of. Nor should the combinations (^) be regardeti as competing 
mth, or contradicting, the general recommendation, cited in the first 
paragraph of Sec. 4.1, that w be taken less than (t/S. or better, less than 
(3-/4. The object of thU general recommendation is to limit the inevitable 
loss of precision of estimates of parameters caused by rounding, and 
relates to the case where the choice of a rounding interval is yet to be 
made. Combinations (20), on the other hand, are not concerned ndth 
the loss of precision of estimates as a consequence of coarse rounding 
bvit are proposed as a rough indication of the circumstances under which 
data can be validly analyzed by simple modifications of standard 
procedures. 

6.4. Distribution of Student’s t and the Variance Ratio When Based on 
a Small Number of Rounded Observations 
Like the distributions of all functions of rounde<l observations, the 
distribution of defined in equation (16) of Sec. 4. .5, is discontinuous. 
However, since the discontinuities of the distribution of in and the 
distribution of Sx^ jointly affect the distribution of its discontinuities 
are more numerous in any ^ven interval than those of the distributions 
of fs and Sx^, and, generally, the steps arc smaller than those of the dis- 
tribution of Sx^. On the other hand, whenever equals zero, this 
causes to be either + or — oo ^ according to the sign of the numerator 
with the exception of those cases in which i* equals the population mean 
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when tx^ can be defined to be equal to +l or —1, the sign being 
determined in a given instance by a random mechanism giving each sign 
equal probability.* The last-mentioned situation cannot occur unless 
/i'l., is a multiple of \/N an<l will occur very rarely even when it is a 
possibility. On the other hand, it can be .seen from Table 4.9 that infinite 
values of tx^ may occur with annoying frctiuency in very small samples, 
for example N < A, when coarse rounding is involved. If, however, 
the rounding employed with a given is in accord with the recommenda- 
tions (20), then the probability of an infinite value of wall be less than 
U.OOl. Furthermore, the rounding so chosen wall simultaneously render 
the steps in the distribution of tx^ negligible, so that for practical purposes 

may be regarded as following the standard t distribution, which is 
strictly valid only for U. 

Similar considerations apply to the distribution of the ratio Fr of two 
mean squares, 5^,^^ and which arc such that in the absence of the 
rounding nisf and nas| would be distributed independently as for ni 
and nz degrees of freedom, respectively. In particular, F'r * 
will equal 0 whenever is 0; it will equal infinity whenever is 0; 
it may be defined to be 1 when both and 51,^^ are 0. Four exact 
distributions of Fs were calculated from the distributions of giv'en in 
Tables 4.4 to 4.7. The cases considered were ni * tij = 1, w = <7, cr/2, 
it/4-, ai = rij * 2, i4> = <t. As expected, the discontinuities of Fr ^vere 
more numerous in any given interval than the discontinuities of the dis- 
tribution of alone, and the steps were smaller. The biggest steps 
were those corresponding to Fr = 0, F* = 1, and Fr = +». From 
the graphs that were sketched it was apparent that if these three steps 
were reduced to negligible size, either by increasing n\ and nj or by 
decreasing w, then the distribution oi Fr would be represented by the F 
distribution to an approximation sufficient for most practical purposes. 
It is believed that if theiVi ( = ni + 1), /V* (= Wj 4- 1), anri the common 
rounding interval satisfy the recommendations (20) above, then Fr may 
be regarded as distributed according to the F distribution for most prac- 
tical purposes. 

If and correspond to different roundings and wa, then the 
distribution of Fr will be biased relative to the distribution of F. This 
bias cannot be eliminated when <r* is unknown, the situation in which F 
tests are customarily employed. 

6. STATISTICAL PROPERTIES OF TABULAR AND INTERPOLATED VALUES 

It is often stated, or implied, in statistical texts that the error of a 
tabular entry may be regarded as a random variable distributed with a 

* The complication of this definition arises because F = % = 1 seems a sensible 
definition, and i = = 0 also seems sensible, but i* = F. The complication avoids 

the implication that 0* = 1. 
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uniform probability density between minus unit and plus H unit in the 
last place. Clearly the rounding error of a given tabular entry has a 
definite value, although it may be unknown to a user of the table. Hence 
the error of a given tabular cntiy is not a random variable in any meaning- 
ful sense of the expression, its distribution being concentrated at n point. 
Therefore, the statement appearing in statistical texts must be intended 
to mean that when one is carrying out computations involving the use 
of a large number of different tabular numbers, the errors of the indi- 
vidual tabular numbers considered collectively will, under favorable 
ciceumstances, range from minus unit to plus ^ unit in the last place 
with approximately uniform density. 

The circumstances may sometimes be quite unfavorable. Thus in a 
given computation involving the use of numbers from only a small 
section of a table — and in certain other less easil}^ specified cases also — 
the errors may all tend to have the same sign or to be bunched in some 
other manner characteristic of the values of the function ^^•hen expressed 
to the given number of decimal places for that particular range of the 
argument. Indeed, the favoral»i)ity of the circumstances may depend 
on the units in which the function is tabulated, as tJie following parallel 
portions of two logarithm tables illustrate: 


N \ 

1 

logio N 

log. N 

9861 

3.9939 210 

9.1963 429 

9862 ' 

3.9939 600 

9.1064 443 

9863 1 

3.9910 090 1 

0.1065 45T 

9864 , 

3.9940 531 1 

9.2966 470 


3.9940 971 

9.1907 484 

9866 

3^.9941 411 1 

9.1968 498 

9867 

3.9941 851 , 

9.1969 511 

9868 

3.9942 291 

9.1970 525 

9869 

3.9942 731 1 

9.1971 538 

9870 

3.9943 172 ! 

9.1972 551 

9871 

3.9943 612 ^ 

9.1973 504 

9S72 

3.9044 051 1 

0.1074 577 

9873 

3 9944 491 1 

9 197.5 590 

9874 

3.9944 931 

9.1976 G03 

9875 

3.9945 371 | 

9.1977 616 

9876 

3.9945 811 

9 1978 629 

9877 

3.9046 251 

9.1979 641 

9878 

3.9946 690 

9.1980 65.8 

9879 

3.9947 130 1 

9.1981 OOt) 


These logarithms are given above correct to 7 decimal places. From an 
examination of the digits in the seventh place in the case of the values of 
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logio it is apparent that if one is calculating with the aid of logarithms 
read from a 6-place table of logic and the values of A" involved are 
limited to the range shown above, the errors of the logarithms >vill be 
bunched around a value of one-tenth unit in the sixth place and quite 
definitely will not ^bc distributed more or less uniformly from minus 
^ unit to plus ^ unit in the sixth place. On the other hand, if the 
computations are carried out with the aid of a 6-pIace table of log* iV, then 
even though the values of M involved are confined to the range shown 
above, the errors of the logarithms wioy be fairly uniformly distributed 
between minus unit and plus unit in the sixth place, although 
there will be a gap in the distribution of the error in the vicinity of 
two-tenths unit in the last place. 

Since there is a definite relationship between the exact values of a func- 
tion for successive values of the argument, there is likewise a definite 
relationship between the errors- due to rounding in the tabular values 
given correct to n decimal places. Hence the errors due to rounding to 
n places are never actually equivalent to independent observed values of a 
random variable uniformly distributed between minus and plus 
unit in the last place retained. Nevertheless, if a large number of entries, 
corresponding to widely dispersed values of the argument, are examined, 
the figures beyond the nth place will often form decimal fractions that 
appear to bo more or less uniformly and independently distributed 
between 0 and 1 in units of the last figure retained; in some cases, this is 
true even for relatively small values of n. Furthermore, when the 
function tabulated is irrational or transcendental, the larger the value 
of n, the more nearly do the decimals beyond the ntli place form decimal 
fractions that seem to be uniformly and independently distributed, for a 
given spacing of the argument. There are exceptions, of course. For 
example, the functions lO^/O, lO^/OO, lO^/DOO, etc. for m — 0, ±1, ±2, 

. . . , which have only O’s and I’s in their decimal expansions, do not 
exhibit either of the aforementioned properties. Similarly, tables of 
good functions may have some bad patches. However, the fact that 
the above properties are quite common, especially in the case of decimal 
expansions of irrational and transcendental numbers, suggests that in 
many cases it may be useful to regard the errors in tabular numbers due 
to rounding as uniformly and independently distributed between plus ^ 
and minus unit in the last place tabulated — provided one exercises 
reasonable judgment in applying the deductions from this assumption 
in individual cases. 

Let us assume then, with the foregoing reservations, that when the 
error of a tabular number due to rounding lies between ±w/2, the error 
€ is distributed with uniform probability density between It 

follows immediately that 
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Mean error = — 


-~f 

w J 

. r 1 

a, = variance ol errors = — I 

10 j , 




de = 0 




« = 12 = 0.0833io2 


(23) 


( 22 ) 


wlienco tne standard deviation of the errors is 


O’* 


^ - 0.2887WJ 
a/T^ 


(23) 


Consequently, if rounding errors arc viewed from this statistical view- 
point, equation (21 ) implies that rounding is unbiased, that is, the average 
difference between the rounded tabular entry and the true value of the 
function will be zero. Maintaining the statistical viewpoint, it follows 
that the sum of the errors of k entries that are “correct" to within 
±w/2, assuming independence of the errors, will b e dist ributed about 
a mean of zero with a standard deviation of w \/kfl2; furthermore, 
the distribution is approximately normal (Gaussian) for A > 4.* 

As an example of the use of this result, consider a tabulation, sup- 
posedly correct to 5 decimals, of the nine terms in tlie expansion of 
(p + ?)* for p = t/O. The sum of the nine values is l.OODOS. Does 
this discrepancy of 0.00003 from the true sum suggest that a mistake 
has been made in the calculations? The maximum admissible dis- 
crepancy is bounded by ±0.000045, so there is no positive proof that the 
calculations arc in error. The observed discrepancy, measured in units 
of 0.00001, corresponds approximately to a normal deviate of 


(3-0) 

VK2 


3.4G. 


Since the probability of a normal deviate differing from 0 by more than 
2.576 is Jess than 0.0I,f ft is advisable to check the calculations (prob- 
ably starting with the sum). 

Fisher and Wishart| have used the statistical viewpoint to determine 
the distribution of the error of an interpolated value when the values 
of the argument are equally spaced. Let the spacing of the argument be 
taken as unity, and let 0 to 1 represent the interval containing the value 

• For details, see the papers by Baten, Hall, Irwin, and lliete listed in Sec. 7. 
t This may be verified from Table 1.1 of Chap. I, since the probabOity is 2(0.005) 
that a normal deviate will be either above or below —K„ oo»- 

t Fisher and Wishart, “On the Distribution of the Error of an Interpolated 
Value.” 



Sec. 6 


ROUNDING DATA 


219 


of the argument p for which it is desired to obtain an interpolated value; 
then, if the interpolation is performed without recourse to differences, 
using Lagrangian interpolation coefficients,* the error of the interpolate 
can he expressed simply in terms of the tabular entries used to obtain it. 
It is, in fact, the “interpolate” of the erroi's: 

Error of linear (2-pomt) interpolate = (1 — p)€o + pti 
Error of quadratic (3~point) interpolate 


_ p(p ~ l)€_i + 2(1 — p^)co + p(p + l)ei 
2 

m 

Error of (27n)-point interpolate = ^ Al"'(p) • ci 

+ 1 
m 

Error of -f l)~point interpolate = ^ ' ft 

k ^ —m 


( 24 ) 


If the errors of the tabular entries may be regarded as independent 
random variables with a common variance then the I'ariance of an 
r-point interpolate for argument p is simply 

V(p,r) = y UUp)? • (25) 


where the summation is over k from — tw + 1 to m when r * 27ri, and 
over k from —m to d-m when r » 2m + 1. In particular t 


and 


T^(p,2) * variance of 2-point Lagrangian interpolate (26) 
= [(I - py + p>- = [1 - 2p(i - p)]y 0 < p < i 

^(Pi3) — variance of 3-point Lagrangian interpolate (27) 
^ bHp •- 1)^ + 4(1 - y-^y + pHp + 

= 0 < p < 1. 

4 


It c&n be determined readily by differentiation that the minimum 
value of F(p,3) corresponds to p = ±l/\/2 and equals 


5v* 

8 


= 0.62500(t2 


• For numerical values of these coefficients for 3<point up to 1 1-point interpolation, 
see Mathematical Tables Project, Tables of Loffrangian Interpolation Coefficienia; 
formulas for these coefficients arc ^ven in the introduction to the tables. 

t Expression (26) is identical to that given by Fisher and Wishart, p. 914. In 
place of (27) they give an equivalent expression in terms of a variable p that varies 
from 0 to 1 when, the p of (27) varies from — to -hM- 
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which exceeds the minimuci value of F(p,2), namely ff®/2 = O.SOOOOo-®, 
which corresponds to p = Also, for 0 < p < I, it is clear that the 
maxima are ^(0,2) = V(0,3) = F(l,2) = F(l,3) = Table 4.10 
shows the minima and the average values of V{p,r), 0 ^ p < 1, in the 
case of (2?n)-point interpolation (m = 1, 2, 3, 4), and the practical 
minima* and the average values for — ^ P ^ 

(2m 4- l)-point interpolation (m = 0, 1, 2, 3). 

TABLE 4.10 

Minimum and Average Values of tub Variance op an r-roiNT Interpolate fob 
AN ArQUMENTBETWEENO AND 1 WheN r Is E\mN, AND BETWEEN AND WhBN 
T Is Odd, the Values of the Aboumbst Beino Spaced at Unit Intervals and tub 

ERROBa OP THE TABULAR ENTRIES BbING INDEPBNDENTLT DISTRIBUTED WITH A 

Common" Variance 


Interpolate 

Minimum Variance* 
(units of <r*) 

Average Variancet 
(units of ff") 

1-point (an entry) 

1.00000 

1.00000 

2-pomt (linear) 

0.50000 

0.66666 

3-puml 

0.71875 

0.89376 

4- point 

0.64062 

0.77566 

5- point 

0.74060 

0.89574 

6- point 

1 0.70590 

0.82244 

7-point 

1 0.76579 

0.90291 

8- point 

1 0.74533 

0.84942 

infinite- point 

1 .00000 

1,00000 


* In the esse of (2m)-pouit interpolftUon. (he valuee ehnwn are actual minima, occurring at p — H; 
and MV the case of (2in + l)'pMtvt interpolation, they are practical minima, occurring at p « ±}4. 
For explanation, see text. 

t From Fisher and Wishort. pp. P14-915. The average has been taken over the interval 0 IS p S I 
in the case of (2fn)-point interpolates; over the interval — H ^ P ^ 4*^* m the ease of (2m + l)-pomt 
interpolates, 


In summary, if the errors of the tabular entries may be regarded as 
independent random variables with a common variance if the values 
of the argument are uniformly spaced at unit intervals, and if r-point 
interpolation for the interpolate corresponding to argument p, with 
0 < p < 1 for r even and — < p < for r odd, is carried on with- 

out differences, then 

(1) The variance of the random error of the interpolate is always 
less than the variance of a single tabular entry. 

* In the ease of {2rn + l)-poiDt interpolation for )^ < p < 1, a more accurate 
interpolate can be obtained by taking p » L as origin, dropping the tabular entry 
for k = — m, adding the entry for A: = m + I, and using 1 — p as argument. With 
this convention, V(p, 2m + 1) will have a practical minimum at p = ±1^, although 
actual minima occur at p = ±p' with |p'| > }^. 
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(2) The variance of the random error of the interpolate is least for 
linear (2-point) interpolation. 

(3) The variance of the random error of a (2m 2)-point inter- 
polate is greater than the variance of the random error of a (2m)-point 
interpolate, but less than the variance of the random error of a (2m -f- 1)- 
point interpolate. 

(4) The variance of the random error of a (2m -j- 3)-point inter- 
polate is greater than the variance of the random error of a (2m -{- 1)- 
point interpolate. 

From (3) and (4) it is clear that, if (2m)-point interpolation does not 
yield the accuracy desired, but either (2m -|- l)-point or (2m + 2)- 
point will,* then it may be advisable to employ (2m -j- 2)-point rather 
than (2m l)-point interpolation in order to minimize the loss of 
precision. 

It should be noted that these results require merely that the errors 
of the successive tabular entries be regarded as independently distributed 
wth a common variance — it is not assumed that the errors are due solely 
to rounding and are distributed with uniform probability density between 
— uj/2 and +w/2. The results are, of course, applicable to this case, 
with — u>2/12, as given by (22), when the independence assumption is 
tenable. Fisher and Wishart point out, however, that in this latter 
case the distribution of the error of the interpolate is more or less intrac- 
table, and does not tend to the normal (Gaussian) distribution (ffs tends 
to 2.2 and not to 3) as r increases. This somewhat limits the usefulness 
of the standard deviation as a measure of the random error of the interpo- 
late, although the inequalities of TchebychefT and of Camp and Meidell 
are still applicable.f Since, by (24), the error of an interpolate is a 
linear function of the errors of the tabular entries when the interpolation 
is carried out >vithout recourse to differences (that is, by using Lagrangian 
interpolation coefficients), the error of the interpolate will be normally 
distributed when the individual errors are independently and normally 
distributed with a common variance. Accordingly, they note that a 
table printed to one or two places more than are correct is capable of 
yielding a more accurate and more precise interpolate than the same 
table with the entries cut down, provided that the standard deviation 
of an entry is given and the errors are approximately normally and 
independently distributed about a mean of zero with a common variance. 

♦The reader is cautioned against inferring that (r l)'point, (r + 2)-point, 
and so forth, interpolation always yields greater accuracy than r-point interpolation ; 
he is referred to Steffensen, Interp^dalion, pp. 34-53, for a discussion of the number of 
points to be used in a given instance and for a. simple example in which the accuracy 
becomes worse as r increases. 

t See, for instance, Shewhabt, Economic Control of Quality, pp. 176-177. 
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ACCEPTANCE INSPECTION WHEN LOT QUALITY IS MEASURED 

BY THE RANGE 

1. TYPE OF PROBLEM 

The range, defined as the difference between the largest and smallest 
observations in a sample, is familiar in industrial experimentation and 
quality control as a measure of dispersion in samples. Many applica- 
tions of the range are to normal or nearly normal populations, for which 
the variability is better characterized by the standard deviation. The 
range is used to measure dispersion in samples because of the ease with 
which it can be determined, and because in small samples it is almost 
as efficient a measure of variability as the standard deviation.* The 
present chapter is concerned with an interesting reversal of .these roles, 
where the variability of the lot or process is characterized in terms of the 
range itself but where the standard deviation is used as the sampling 
statistic in acceptance inspection to determine whether the range meets 
specified requirements. 

One type of problem in which the range is the parameter of primary 
interest is that of ensuring the virtual simultaneity of a set of events. 
This set of events may be thought of as a random sample of k units from 
an underlying population of such events, and the requirement of simul- 
taneity as a demand that the time difference between the occurrence of the 
first and last event of such a sample be small. In practice, of course, 
some samples will meet this requirement and others will not, but we can 
formulate the requirement statistically as follows: Let the size of the 

* One statistic is more efficient than another if it varies less from sample to sample 
for a fixed population, that is, if its sampling variability is less. To get a basis of 
comparison, it is necessary to convert values of one statistic into implied values of 
the other. For example, given the range of a sample of N from a normal population. 
an estimate of the standard deidation can be made noth the aid of Tippett's table of 
the mean range, m units of the population standard deviation, for samples of N from 
a normal population. Such an estimate, will va.ry more from sample to .sample than 
if the standard deviation had been computed directly by the usual formula. Con- 
versely, given the sample standard deviation, an estimate of the sample range can be 
formed; such an estimate will vary less from sample to sample than if the range had 
been computed directly. For samples of 2, however, the range and standard deviation 
are equally variable; for samples of 3 the range is slightly more variable than the 
standard deviation, and as the sample size iucreiisett the variability of the range 
increases relative to that of the standard deviation. (For full citations, see Sec, 5.) 

Chap, 3, Sec. 4.4, pp. 160-163, discusses the efficiency of statistics. 
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sample be k, and let U (« = 1 , 2, ■ * * , k) be the time of occurrence 
of the ith event of the sample measured from an arbitrary time origin. 
Denote by Rk the difference between the longest and the shortest of these 
times in a particular sample. Then the requirement for an acceptable 
lot is that in not more than a fraction y of samples of k shall the range 
Rjt e.xcccd a fixed value 17. If the time can be measured for each item 
in the lot, it may be possible to form sets of k in such a way that the range 
is satisfactory in all or nearly all sets. On the other hand, if deter- 
mination of the time alters or destroys the unit, if the time varies from 
one trial to another for a given unit, or if measurement of the times and 
systematic grouping is expensive, there are advantages to a procedure 
such as that suggested, based on random grouping. 

A typical problem of ensuring temporal simultaneity arises in con- 
nection with mechanisms for which there is a certain lapse of time 
between activation — for example, closing a snntch— 'and operation. If 
such mechanisms are used in assemblies of two or more activated from a 
single source, it may be important to the functioning of the assembly that 
these time lapses be nearly equal, in other words, that all the operations 
occur within a brief interval. This need can be fulfilled by requiring 
that each lot of the component mechanisms be such that the range of 
delay times in random sets of k meclianisms be less than some predeter- 
mined constant. It is not possible, without testing the entire lot, to 
assure that every set of k formed at random from a lot will have an 
acceptable range; but it is possible by sampling inspection to obtain any 
required level of assurance, short of certainty, of detecting lots worse 
than any specified quality P, as measurc<I by the percentage of sets of 
k in which the range is too large. 

Problems of controlling the difference between the largest and smallest 
measurements in a group of k items are not confined to situations involv- 
ing temporal vaj-iability. Balance may require that a set of k objects 
not show ,ioo great a range in weight; flatness or straightness may 
require that a set of k items not vary too much in thickness or length; 
appearance may depend upon the range of variation within sets of k rather 
than upon some other type of variability. 

2. METHOD OF SOLUTION 

It is clear that when acceptance inspection is based on samples, 
there is always a risk that when good lots arc offered they will be rejected, 
or that when bad lots are offered they will be accepted. The former 
risk depends on the freciuency wdth which gooil lots yield bad samples, and 
the latter on the frecjuency with w^hich bad lots yield good samples. 
These frequencies can be made as low' as we please by taking sufficiently 
large samples and choosing the acceptance cxitCTion properly, but they 
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canaot be eliminated except by complete ii^pection of the lot. Follow- 
ing established usage, we shall call the first kind of risk the “producer’s 
risk” and the second kind the “consumer’s risk.” 

For concreteness, let us assume that a lot of acceptable quality 
is defined as one in which the probability is at least pi = 0.99 that the 
range of 14 items selected at random will be less than 0.3, measured in 
whatever units are appropriate. Let us suppose further that the pro- 
ducer’s risk is to be a small quantity, say a = 0.01 ; that is to say, if lots 
of quality px are offered we wish to reject them, on tlie average, no 
oftener than 1 time in 100. Suppose that a lot is unacceptable if the 
probability is pa = 0.85, or less, that the range of 14 items selected at 
random will be less than 0.3; and that the consumer’s risk — the proba- 
bility of accepting a lot of quality pi or worse if offered — is to be at most 
^ = 0.01. Finally, let us assume that the distribution of tlie quality 
characteristic is adequately represented by a normal distribution. * 

For a normal distribution the probability that the range of k inde- 
pendent observations is less than some preassigned number U depends 
only on the standard deviation <r. Thus, the criteria of acceptable and 
unacceptable lots, which were expressed abbve in terms of the proportion 
of the ranges of sets of 14 that are less than 0.3, can be expressed in 
terms of the lot standard deviation <t. It follows that the acceptance- 
inspection plan can be formulated in terms of the sample standard 
deviation, or, as proves to be more convenient in practice, in terms of the 
sum and the sum of squares of the observations. This reformulation of 
the. definition of an acceptable lot permits a great gain in the efficiency 
of the inspection plan; for in using the sum of squared deviations as a 
measure of acceptability we make full use of the information provided 
by inspection of the sample, rather than of just that portion of the 
information given by selecting the extreme individuals in each group of 
14 observations. 

Let Ox be the value of the lot standard deviation that defines good 
quality. Then ox depends on the group size ft, on the acceptable value 
U of the range in groups of ft, and on the proportion of ranges that 
can be allowed to exceed U. These three quantities are related to tr, 
through the cumulative distribution of the standardized range, Avhich 
gives the probability that the range Rk of ft items from a normal dis- 
tribution will exceed any specified multiple TF* of the population standard 
deviation <r. Tables of the cumulative distribution of the range have 
been published by Pearson. f In Fig. 5.1, which is based on Pearson’s 

• If the assumption of normality is not justified, the inspection can be carried out 
on an attributes basis, by classifying each group of 14 in the sample as satisfactory 
or not. 

t Pearson’s table gives cumulative probabilities to 4 decimal places for values of k 
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tables, the vertical axis shows the probability that Rkh will exceed the 
values of W shown, on the horizontal axis, and the various curves cor- 
respond with various group sizes k. For our purposes, K is given, TY 
is obtained from Pearson’s table or from Fig. 5.1, and c is the quotient 





pals for |h«i« <wrv«s an from E. S. Pasroeii, 1942.- 

Fia. 5.1. — Cumulative probability distribution of the range in samples of ft from a normal 

populatioa. 

For the illustration cited, we find the value of IF ’14 corresponding with 
probabilities of 0.99 and 0.85 on the curve for k = 14. These are 5.40 
and 4.20, respectively; on substituting them and Rm = 0.3 into (1), we find 
}/[8 and K 4 as the values of <ri and 

Thus the problem becomes that of devising, an inspection procedure 
for the standard deviation such that the operating-characteristic curve 
passes through the two points 

(in his notation n) from 2 to 20 by steps of I and for ^'aluea of ir from 0 to 7.25 by 
steps of 0.01. 
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<ri = 0.05556 = 0.99 (2) 

(Tj - 0.07143 U\ = 0.01 (3) 

Such an inspection procedure may be carried out by either single or 
sequential sampling. The solutions are indicated only briefly here.* 


3. SINGLE SAMPLING 

To determine the required sample siae, "we computet 


P = 



1.6531 


(4) 


Then in a table of we find the number of degrees of freedom n for which 



(5) 


where x? denotes the value of x* exceeded with probability e. 

In the present example, since a = /3 0.01, we may refer to Table 8.2 

and seek 1.6531 in the column for 0 = 0.01; however, the table shows 
only that n > 120. We therefore use the large sample approximation! 


_ 1 / Ka<ri 4- A'giTa V 

2 \ <r2 — / 

= 173 


( 6 ) 


■where Ka and Kg represent normal deviates exceeded with proVjabilities 
a and respectively, which may be found from Table 1.1 in Chap. 1. 
Thus 173 is the number of degrees of freedom required, and since the 
mean is unknown the required sample size is 

iV = n + 1 (7) 

= 174 


From the sample of 174, we calculate 



»“i 


(8) 


where Xi (i = 1,2, • • • , JV) represents the value of the fth measurement 
in the sample. The lot is rejected if S > So, where 


So = (9) 

* For a discussion of tests of the standaxd deviation see, on single sampling, 
Chap. 8, and, on sequential sampling, Chap. 17 Iwlow and Statistical Reseaich Group, 
Sequential Analysis, Sec. 6. 

fSee Chap. 8, Sec. 2.4, especially Example III, pp. 272-274. 

X See Chap. 8, Sec. 2.4, first footnote on p. 274. 
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in which xl(’i') represents the value of x* for n(= iV — 1) degrees of 
freedom exceeded with probability a; other\vise the lot is accepted. In 
the present example, n is outside the range of the tables, so we use 
the approximation (due to R. A. Fisher) 


xL(») = 


(X^-+ V2n- 

2 


= 218.410 


(10) 


The OC curve is easily obtained from the fact that the probability 
L„ of accepting a lot of quality <r when offered is simply the probability 
that a value of based on n degrees of freedom will be less than S^/a^. 
When a = 0.01 or 0.05 and n does not exceed 120, Table 8.1 or 8.2 
provides 13 points on the OC curve; values of are shown for various 
values of L„. When n is beyond the range of the table, the OC curve 
can be found from 


(fC, d- \/^)<ri 

VTn- 


4. SEQUENTIAL SAMPLING 

A sequential-inspection plan based on standard deviations is defined 
by two parallel straight lines given by the formulas 

Zn = hi sn (rejection line) (12) 

2’a * —hi -1- sn (acceptance line) (13) 


where hi, hi, and s are positive, n represents one less than the number of 
observations taken sequentially, and 


Z. 



(M* 

n + 1 


is the sum of squares of deviations of the n + 1 observations from their 
mean. 

The sequential procedure is as follows; Draw the two parallel lines 
given by eciuations (12) and (13) with Z„ on the vertical scale and n on 
the horizontal scale. Start taking observations, beginning with two 
observations and thereafter adding one observation at a time. After each 
observation compute Z„ from all observations and plot its value against 
the corresponding value of n (winch is one l^s than the total number of 
observations thus far taken). If at any stage the plotted point falls on 
or above the upper line, given by equation (12), reject the lot; if it falls 
on or below the lower line, given by equation (13), accept the lot. If, 
however, the plotted point falls between the two parallel lines, take 
another observation. Continue this proce^ until a decision of acceptance 
or rejection is reached. 
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The two intercepts —hi and hi and the common slope s, which deter- 
mine the two parallel lines, are given by 

I - a 


2 lOge 


hi = 


id 


_l_ 


(14) 


<ri 


= 0.071799 

1 -/s 


2 log* 


hi = 




ff| 


(15) 


= 0.71799 


and 


log* 


a = 




<ri 


(16) 




- 0.00392C8 

The OC curve for the sequential plan is computed from the following 
formulas: 




— e' 


L, - 


( 17 ) 


21 ^ ^a,+k,) _ 1 

It will be observed that L,„ the ordinate of the OC curve, is not given 
directly as a function of <r, but parametrically through a third variable t 
in terms of which <r is also defined. The OC curve for this example is 
shown in Fig. 5.2. 

The average sample number (ASN) curve shows the relationship 
between the standard deviation in the submitted lot and the average 
number of items that will be inspected before a decision is reached. The 
ordinate Na of the ASN cur\'e, corresponding to the abscissa <t, is given by 


jV = + hj) — kj _j_ j 


« — o-* 


(18) 


where La and <r are given by equations (17), Formula (18) can be evalu- 
ated directly for every value of <r except <r = V^, for which it can be 
shown that 

hihi 


N./- = 


Vi 2»* 


+ 1 


(19) 


This will ordinarily be close to the maximum average amount of inspection 
required to reach a decision. The ASN curve for the present example 
is included in Fig. 5.2. 
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Fia. 5.2.— OC and ASN curves for sequential-aampling pltiii bused on standard devi- 
ation; ffi = 0.05550, tr, =0.07143, a =0.01, ^ = O.Ul; hi =0.07180, ht =0.07180, 
a = 0.003927. 
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CHAPTER 6 


VARIABILITY OF AMOUNT OF INSPECTION 

FOR DOUBLE, MULTIPLE, AND SEQUENTIAL SAMPLING 

1. SINGLE, DOUBLE, MULTIPLE, AND SEQUENTIAL SAMPLING 

Sampling inspection is said to be based on attributes if inspection 
of each item results in its dassifieation as defective or nondefective, and 
disposition of the lot or process from which the sample comes depends 
upon the number of defectives found in tlie sample. One or more sam- 
ples are selected at random from the lot; if the total number of defectives 
found in the first k samples does not exceed an acceptance number A*, 
the lot is accepted ; if it equals or exceeds a rejection number Rk {Rk > Ak), 
the lot is rejected; if it falls between A* and Rk, another sample is 
inspected, 

A single-sampling plan is one for which 

.Ri = Ai d" I (1) 

A double-sampling plan is one for which 

Ri ^ Ai -J- 1 

ff2=A2-|-l (2) 

A multiple-sampling plan is one for which 

Rk> Ak-]- I for A: < 2 (3) 

Rk — Ak -]- I for some k > 2 

In a sequential-sampling plan, the successive samples are all of size 1 and 

Rk — Ak = C -]- bk (4) 

where C is some constant and each 5i Is 0 or 1.* 

• For an exposition of single, double, and multiple sampling, see Statistical 
Research Group, Sampling Inspedion; what is here called “multiple sampling’' is 
there called “sequential sampling,” and what is here called “sequential sampling” is 
there called “item-by-item sequential sampling.” For an exposition of sequential 
Sampling see Chap. 17 of this volume, or Statistical Research Group, Sequential 
Analysis. (For full citations, see Sec. 5.) 

Equation (4) is a necessary condition for a sequential-sampling plan, but it ia not 
quite a sufficient condition unless further conditions are imposed on the 5^. 
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2. VARIABILITY OF AMOUNT OF INSPECTION 

One of several factors determining the relative merits of single, 
double, multiple, and sequential sampling is the variability of the amount 
of inspection for plans giving equivalent operating-characteristic (OC) 
curves. Variability of the amount of inspection causes fluctuations 
in the inspection load and thus may create administrative problems in 
an inspection program. 

Variability may be interpreted in two ways. First, it may mean 
variation in the average number of items inspected per lot as the quality 
of submitted lots varies; in other words, the amplitude of the rise and 
fall of the average sample number (ASN) curve. Second, it may mean 
variation in the number of items inspected for lots of a given quality. 

Clearly, single sampling will show less variability, in either sense, 
than double, multiple, or sequential sampling. In fact, with single 
sampling there mil be no variability of either kind unless inspection is 
curtailed, that is, terminated as soon as the rejection number is exceeded 
or the number of items remaining uninspected is insuflicient to cause 
rejection even if all are defective. 

No general relations among the variabilities of double, multiple, 
and sequential plans are known. The purpose of this chapter is to 
present two illustrative comparisons. These two comparisons suggest 
by their differences that no simple conclusions about the relative varia- 
bility of the three types of sampling are valid. In the illustrations it is 
assumed that the first sample of the double and multiple plans will be 
inspected completely (this being usual* to facilitate estimation of the 
process average), that inspection of later samples will be curtailed as 
soon as the rejection number is reached, but that curtailing will not be 
applied to accepted lots. 

3. ILLUSTRATIONS 

Example I. Table 6.1 presents a set of double, multiple, and 
sequential plans whose OC curves are nearly the same.f Figure 6.1 
shows their average sample numbers N as functions of lot quality, 
and Fig. 6.2 shows their standard deviations (t{N) of amount of 
inspection for lots of a given quality as functions of lot quality. 

Example II. Table 6.2 presents a second set of plans with match- 
ing OC curves;! Fig. 6.3 shovvs iV as a function of lot quality, and 
Fig. 6.4 shows <r{N) as a function of lot quality. 

• It is not, however, necessary. See Girshick, Mosteller, and Savage, 
"Unbiased Estimates for Certain Binomial Sampling Problems with Applications." 

t The OC curves of the double and multiple plans are shown in Table 4 of Sampling 
Inspection for sample size letter H, acceptable quality level (AQL) class 0.32-0.65 
percent defective (p. 288). 

{ The OC curves of the double and multiple plans are shown in Table 4 of Sampling 
Inspection for sample size letter K, AQL class 3.2— 4.4 percent defective (p. 330). 
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TABLE G.l 

Double, Multiple, Sequential Plans op Example I 


DOUBLE SAMPI^INO 




Sample 

size 

Combined samples 


Sam plo 




First, 

60 

50 


0 

3 

Second. . 


100 

150 


2 

3 


1 




MULTIPLE SAMPLING 


Sample 

Sample 

size 

Combined samples 

Size 

Acceptance 

number 

Rejection 

number 

First 

1 20 

20 ■ 

1 • 

2 

Second 

20 

40 

* 

2 

Third 

20 

60 

0 

2 

Fourth 

20 

80 

1 

3 

Fifth 

20 

100 

1 

3 

Sixth 

20 

120 

1 

3 

Seventh 

20 

140 

2 

3 


* Acceptance not permitted until three samplee have been inspected. 


SEXIUENTIAL SAMPLING 

a “ 0.05 & — O.IO Pi = 0-005 pi = 0.05 
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N 



Fig. 6.1. — ASN curves for double, multiple, and sequential plans oi Table 6.1. 
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Percent defective in Igl 


I'lG. 0.3. — ASN curves fur double, multiple, aad sequential plans of Table 6.2. 
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(r(N) 



Flo. 6.4. — a(.N) curves for double, multiple, and sequential plans of Table 6.2. 
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TABLE 6.2 

DotJBLE, Multiple, and Sequential Plans op Example II 

DOUBLE SAMPLING 




Sample | 
size 

1 Combined samples 


Sample 

i 

Size 

Acceptance 

1 number 

Rejection 

number 


150 ^ 

150 


9 ^ 

24 


300 

450 


28 1 

24 




MULTIPLE SAhtPLIKO 


Sample 

Sample 

size 

Combined samples 

1 Size 

[ Acceptance 
number 

[ Rejection 
number 

First 

50 


1 

6 

Second 

50 


3 

9 

Third 

50 


7 

13 

Fourth 

50 



16 

Fifth 

50 


13 ' 

10 

Sixth.' 

50 


16 

22 

Seventh 

50 ' 


19 

25 

Eighth 

50 1 


24 

26 


SEQUENTIAL SAMPLING 


a » 0.05 9 « 0.10 p, - 0.0410 pt - 0.0920 

4, computational methods 

For double and multiple sampling, N and o-iN) may be calculated 
by an extension of methods described in Sampling Inspection, Chap. 17. 
For sequential sampling, the computations for are based on 

the formula derived in Sequenli(U Analysis, Sec. B.0921, and those for 
tT{N) on the relation 

cr=(JV) = E{]^^) - (E(Ar)P (5) 

where the formula for E{N^) may be obtained by an extension of the 
method used in Sec. .5.0921 of Sequential Analysis for obtaining E{N). 
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CHAPTER 7 


PLANNING AND ANALYZING EXPERIMENTS FOR COMPARING 
TWO PERCENTAGES 

1. TYPE OF PROBLEM 

The type of problem dealt with in this chapter may be indicated 
by a simple example. Suppose that trials of two fire-control devices 
have resulted in the following data: 


TABLE 7.1 



Hita 

Aliases 

Total 

Old 1 

3 

■1 

^ 200 

New 



1 200 

Total I 


893 

1 

400 

1 


The question is whether the new method, which shows 33 percent more 
hits than the old, can be e.vpected to yield more hits in the Jong run; or 
whether its superiority in this experiment ought to be regarded as mere 
chance, in the sense that two series of trials with the same method would 
often differ as much. 

We may look at the question this way. From 100 rounds, 7 hits 
were secured. If th$ two methods are really equally good in the long 
run, these 7 hits should be divided between the two series in proportion 
to the total numbers in the series, except for chance variations. In 
the present case we should expect the 7 hits to be divided equally between 
the two series; and similarly the 303 misses. As it happens, the division 
in Table 7.1 is as nearly equal as it possibly could be, since the entries 
aro necessarily integers. It is therefore immediately obvious in this 
particular instance that the probability is one-half that, if tho two 
methods were really equally good in the long run, a single experiment 
would show for the new method as much (or more) apparent superiority 
as is shown in Talde 7.1. (If this is not obvious, it can be verified by 
the method described below for use with cases where the answer is not 
apparent.) 

Data such as those of Table 7.1 represent a double dichotomy. 
The observations are dichotomized according to one criterion — that is, 
they are divided into two mutually exclusive and exhaustive classes — and 
then each class is dichotomized again according to a second criterion. 
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The result of doubly dichotomizing the data is, of course, the same 
whichever criterion is applied first; that is, we may regard the data 
as classified first by method (old or new) and then by effect (hit or miss), 
or we may regard them as classified first by effect and then by method. 
The marginal totals of Table 7.1 represent two independent dichotomies 
of the data; they do not constitute a double dichotomy. The problem 
may be put in either of two ways: (1) Is the division between effects the 
same for both methods? (2) Is the division between methods the same 
for both effects? These questions are logically identical, though for a 
particular problem one of them usually seems more natural than the other. 
The problem is thus to test the homogeneity of a pair of dichotomies. 

2. METHOD OF ANALYSIS* 

2.1. Exact Method 

In order to illustrate the general procedure for testing the homo- 
geneity of a double dichotomy such as that of Table 7.1, consider -the 
data of Table 7.2, where the answer is not immediately apparent. 


TABLE 7.2 



Successes 

Failures 

Total 

Standard ... 

2 

198 

200 

Experirnontal . . ... 

5 

195 

200 

Total 

7 

393 

400 


For convenience and generality the two methods compared are hero 
designated “standard” and “experimental” and the two possible outcomes 
of a trial with either method us “success” and “failure.” In practice, 
of course, the two methods may be equally experimental or equally 
standard, and the two possible outcomes may be two types of success or 
two types of failure or merely two different outcomes not properly 
regarded as either success or failure. 

It might appear, in view of the remarks in Sec. 1, that we could 
treat the 2;5 division of successes like a 2:5 division of heads and tails 
on 7 tosses of a coin, using the binomial distribution to find the probability 
of as many as 5 heads on 7 tosses if the coin w'ere really unbiased. Table 
7.2, unlike Table 7.1, however, gives different answers for the successes 
and failures columns according to this treatment; so some other method' of 
analysis is called for. (In this particular instance, however, it happens 
that analysis of the seven successes according to a binomial distribution 
gives an excellent approximation to the correct probability, because both 
proportions of successes are small; see below. Sec. 2.2, p. 255.) 

We proceed as follows. Let P designate the true long-run probability 

*See Fisueh, Statistical Methods, Secs. 21, 21.01, and 21.02. (For full citations, 
see Sec. 6.) 
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of a success, that is, the probability of a success in the population from 
which the sample comes. P, of course, is unknown, for we should have 
to carry out an infinitely long series of trials to measure it. But wc 
make our calculations on the assumption that P is the same in both 
series, and, as we shall see, it cancels out. If, on the assumption that P 
is really the same in the long run for both series, we find that a difference 
as great as that shown in the data would be unlikely, then the fact that 
this unlikely difference has actually been observed experimentally leads 
us to conclude that the assumption was wrong — to conclude, in other 
words, that the long-run probabilities are not equal, 

The probability that 200 trials will show exactly 2 successes is, by 
the binomial distribution, 

Similarly, the probability of exactly 5 siutc^ses is 

9001 


So the probability that the two series of 200 trials will show exactly 2 
successes for the first series and exactly 5 for the second is the product of 
(1) and (2) 


200 ! 200 ! 

2!5!195!198! 


P’(l - P)’*'* 


(3) 


This ia an absolute probability, whereas wc require the conditional 
probability that if exactly 7 successes and 393 failures occur in the two 
series they will be divided between the series as shown in Table 7.2; 
hence (3) must be divided by the probability df exactly 7 successes in 
400 trials. 


400! 

7!3931 


7>7(1 _ p)393 


(4) 


The probability that if we get 7 successes among two series of 200 eacli, 
they wll be distributed 2 to the standard method and 5 to the experi- 
mental, is the ratio of (3) to (1), or 


7I393I2001200! 
400!2!5!J95!I98! ” 


(5) 


It should be noted that expression (5) would be the same if expressions 
(1), (2), and (4) had been formed from the two columns instead of from 
the two rows of Table 7.2. 

In general, expression (5) is composed as follows: The numerator is 
the product of the factorials of the four marginal totals; the denominator 
is the product of the factorials of the four cell entries and the factorial 
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of their sum. Thus, if we give Tables 7.1 and 7.2 the general representa- 
tion shown in Table 7.3, 

TABT.K 7.3 



Succ^es 

Failures 

Total 



b 


Experimental 

c 

d 

c d 


a + c 

b + d 

a -f- 6 + c + d 



expression (5) may be written 

(a + h)\{c + + c)\ib + d)\ 

a!6!c!d!(a + 6 + c + d)! ^ 

Expression. (5) gives the probability that if in fact the long-run 
probabilities were equal, an experiment involving 200 trials of each method 
and resulting in a total of 7 successes would show exactly the superi- 
ority for the experimental method that is shown by Table 7.2, For 
the final probability to use in judging whether there is a long-run differ- 
ence, we must add to (5) the probabilities of superiorities greater than 
that of Table 7.2. Tables 7.4 and 7.5 show pos.sible results that would 
have indicated even greater superiority for the experimental method than 
does Table 7.2. 


TABLE 7.4 



Successes 

Failures 

Total 

Standard 

1 

199 

mB 

Experimental 

C 

194 



7 

393 

400 




Expression (6) gives the probability for Table 7.4 as 


7I39312001200! 
400!1!G!194!1991 “ 


(7) 


TABLE 7.5 



Successes 

Failures 

Total 


0 

200 

200 

Experimental 


193 

200 



393 

400 




Expression (6) gives the probability for Table 7.5 as 


7 1393 1200(200! 
400 !0!7!193 1200! 


= 0.0074 


(8) 
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The sum of the three probabilities (5), (7), and (8), or 0.2244, is 
the probability that the experiment will show as much or more apparent 
superiority of the experimental method as Table 7.2 shows, if in fact 
there is no real difference. It should be noted that we add together the 
probabilities of only those cases representing greater superiority for the 
experimental method than was observed in the sample. Wo do not 
include the probabilities of cases representing greater superiority for the 
standard than was observed for the experimental method. This is 
because wc are analyzing the data in order to decide whether the experi- 
mental is superior to the standanl method, not simply to decide whether 
there is a difference between the methods without regard to it.s direction. 

Finally, a conclusion is reached regarding the superiority of the 
experimental method as follows: We agree to accept the experimental 
method as superior to the standard on the basis of an analysis of the 
above type only when the resulting probability is less than a, where a is 
chosen in advance and is generally taken to be 0.10, 0.05, 0.01, or 0.001, 
depending upon the seriousness of accepting the expcnmental method as 
superior when it is not. 'J’hcn a is the probability of accepting the 
experimental method as superior when actually there is no real difference 
between the methods. In term.s of any of the usual values of <», the 
probability 0.2244 would imply that the data of I'able 7.2 provide no 
basis for concluding that the experimental method is actually superior 
to the standard. , 

2.2. Short-cut Methods 

The evaluation of the factorials involved in expressions (5), (7), and 
(8) was done by cancellation of common factors. This procedure is the 
simplest in this case, but in general it may be very laborious. Tho 
calculations can be considerably reduced by using a table of the logarithms 
of factorials.* 

A much simpler procedure, which usually yields very satisfactory 
appro.ximatiuns to the e.xaot method described in Sec. 2.2, is available 
when at least two (and preferably five) successes would be expected in 
each cell if there were no difference in the long-run probabilities for 
the two methods. This expected number of successes is computed for any 
cell by dividing the product of the marginal totals for that cell by the 
total number of trials made; thus, the expected number of successes for 
the standard naethod is, on the basis of Table 7.3, 

(a + b)(a 4- c) , , 

a + b + c + d ^ ^ 

•A convenient table i« given ia Fry, Preifabilii^ and Its Engineering Use^. 
Shorter tables can be found in various handbooks. 
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In such cases \vc calculate a quantity xe as follows: 

First, adjust the table of observations so that each frequency is 
brought ^ unit nearer the frequency expected if there were no long-run 
difference between the two methods. This may be done by adjusting one 
frequency and then changing the others so that the marginal totals of 
the new table equal, those of the old. For example, in Table 7.2 the 


7 X 200 

expected frequency for the first cell is — — = 3]^, so we increase 

the observed figure of 2 to 2^^. Changing the other figures to keep 
the marginal totals fixed, we have ' 


TABLE 7.6 



1 

Successes 

Failures 

Total 

Standard . .... 


m 

■1 

Experimental 

iH ' 

mSsm 

■■ 

Total 

7 : 

393 1 

400 


Table 7.6 represents Table 7.2 “correctetl for continuity.”* 

Second, each adjusted frocpioncy is subtracted from the corresponding 
expected frequency, the differences are squared, the squares arc divided 
by the corresponding expected frequencies, and the ratios are summed to 
obtain x?. 

I’he final value* of Xe be obtained directly without going 

through the intermodialo steps, as follows: Calculate the products of 
frequencies diagonally opposite each other in the adjusted table; subtract 
one diagonal product from the other; square the difference; multiply the 
scpiarc by the sum of the four frequencies in the table; and divide this 
product by the product of all four marginal totals. From the data of 
Table 7.6, we have 


X, 


2 


(2H X 195.1^ - X 1971^)2 X 400 
7 X 393 X 200 X 200 


0.5816 


(10) 


More generally, if we replace a, b, c, and d in Table 7.3 by a\ b\ c\ and d\ 
representing the frequencies corrected for continuity, (10) becomes 

^ ja’d’ ~ b'c'yja + + c + d) 

^ (a + + c)(c + d)((> + d) 

* Although this account of the continuity correction describes the procedure 
accurately, it may convey an erroneous idea of the theoretical basis for the correction. 
The general procedure is to carry through the calculation of x from the original data, 
then find the next lowest value of x that could have arisen, and finally take xc as 
halfway between these two valu<». In the particular case of double dichotomies, this 
value of X onn be found most easily by correcting the original data as in Tabic 7.6; 
l)ut in most other cases wlicre the x test is used, correction of the original data will 
lead to serious error in the value of x- For an excellent analysis and presentation of 
this point, see Cochran, “The x* Correction for Continuity,” especially p. 423. 
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Next, we take tJie square root and find Xe ~ 0.7fi2G. This may 
be treated as a normal deviate; that is, the required probability is given by 

( 12 ) 

X. 

Referring to a table of the normal probability integral,* for example 
Table 1.5 of Chap. 1, wo find the probability to be 0.2228. This com-- 
pares favorably with the exact probability of 0.2244 found in Sec. 2.1. 

More accurate values of Xe corresponding to the probabilities 0.025 
and 0.005 than arc implied by (12) are given in Tabic VUI, “Tests 
of Significauce for 2X2 Contiugeiicy Tables/’ in Fisher and Yates, 
Statistical Tables. Detailed instnjctions and illustrations for the use of 
this table are given in its introduction. 

When the percentage of successes is small and the number of trials 
in each series large, as is the case in the examples discussed here, the 
successes may be analyzed by the binomial distribution, along the lines 
discussed in Sec. 1 and the second paragraph of Sec. 2.1.t The value of 
P for the binomial test is the proportion of all trials tliat fall into, say, 
the standard series. In the illustration of Table 7.2, P = Accord- 
ing to the binomial distribution, the probability that seven trials of an 
event having two equally likely outcomes will show as many as five or 
more of a designated type (in other words, the probability that with 
seven successes obsen^ed five or more will occur in the experimental 
series) is 

2^ Tm (nTl) ^ 

This conforms satisfactorily to the exact value 0.2244 found in Sec. 2.1. 
2.3. Alternative Methods 

A procedure that ha.s been widely used for testing the significance 
of the difference between two proportions is based on the following 
considerations: The difference between the two percentages is divided 
by the standartl error of the difference, and the ratio is regarded as 
normally distributed. The standard error of the <IifFerence is computed 
from the familiar relation that the standard error of the difference 
between two independent statistical variables is the square root of the 
sum of the squared standard deviations of the two v ariable.'^. The 
standard error of a proportion p is well knowm to be y/Pil — P}/N~, 

• For a detailed tabic, see the tables prepared by the New York Mathematical 
Tables Project. 

t See Phztborowski and Wile^ski, “Homogeneity of Results in Testing Samples 
from Poisson Scries,” especially Sec. 2, Derivation of Test, pp. 314-317. 
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where P is the true population value of the proportion and N is the 
number of trials. 

Applying these considerations, it is often concluded that 


— Pa) 

Vpsfl — ps) + pfi(I — Pa) 


(l-l) 


where pa is the observed proportion for the experimental method 
Pa is the observed proportion for the standard method 
N is the number of trials with each method 
may be treated as normally distributed with mean of 0 and standard 
deviation of 1. If the probability of obtaining a normal deviate as 
large as V is small, it is concluded that the difference in the proportions 
is greater than can be ascribed to chance. 

There are tw’O serious objections to the procedure by which expres- 
sion (14) is derived: (1) V will not acriially be distributed as assumed; 
and (2) the procedure is not self-consistent. 

With regard to the distribution of V, there arc two considerations: 
Tn the first place, the true population standard deviation of the difference 
is required in the denominator if the ratio is to be normally distributed 
with unit variance when N is lai^e; but actually only experimental 
values are available. Hence, chance variations affect not only the 
numerator but also the denominator of V. In the second place, even 
if wc know the true standard deviation, the distribution of the difference 
(pr — Va) cannot be satisfactorily approximated by a normal distribution 
when the proportions are near 0 or 1, unless N is very large. 

The procedure leading to expression (14) is inconsistent in tw’o 
respects. It sets out to calculate the probability that, if there were 
actually no long-run difference, a difference as great as that observed 
would occur by chance. But if there were no long-run difference in the 
proportions, there w'ould be none in the standard deviations. Therefore, 
when the standard deviation is estimated from the e.xperiment, the esti- 
mate should be based on the two series together. This leads to 
considering 

X = . . (15) 

-b P«)^l - -^ 2 


as a normally distributed variable. 

The second inconsistency in expression (14) may be seen as follow's: 
It would be perfectly logical to find w'hat proportion of the total successes 
were made w'ith the standard method and what proportion of the 
total failures were made with the experimental method. These propor- 
tions should be equal if the standard and experimental methods are 
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equally effective. But if the significance of the difference of this pair of 
proportions is tested by expression (14), the result is not the same as 
when the logically equivalent pair based on methods is tested. Expres- 
sion (15), however, is consistent in this respect as well as in the standard 
error it uses. 

Expression (15) is mathematically identical \vith formula (11) 
in the previous section, except that formula (11) is calculated from the 
data corrected for continuity. Thus, in terms of the frequencies of 
Table 7.3 (without continuity corrections), expression (15) can be 
w'ritten as 

Va + c + d(ad — be) 

^ Via. + b){a + c)(b + d)(c + d) ^ ^ 


with a-\-b=c-\'d = N. This is simply the square root of expression 
(11), neglecting the continuity corrections. When the continuity cor- 
rections are taken into account and N is introduced for simplification, 
expression (16) becomes 


ad - be N 
V{N/9){a -rc)(6 + rf) 


(17) 


Note that N in expressions (14), (15), (10), and (17) represents the 
number of trials in each set. Also note that (17) is valid only when the 
continuity corrections increase a and d and decrease b and c; for the 
reverse situation, -\-N in the numerator of (17) must be replaced by —N. 

Expression (14), though it is theoretically inferior to expressions (15) 
and (17), does not differ materially from them when N is large. Since 
(15) and (17) are theoretically superior and are little or no more trouble 
to calculate, they are always preferable to (14). Even (15) and (17), 
however, are approximations; they fail for very small values of N or 
very small probabilities of a success, and in such cases the procedures 
outlined above in Secs. 2.1 and 2.2 must be used. The procedure of Sees. 
2.1 and 2.2 should be used also when o + 5 is different from c + d. 

For practical work with double dichotomies, the Zubin Item Analyzer 
gives results essentially equivalent to those of expression (14).* In 
this device the difficulties that (1) proportions are not normally dis- 
tributed when the true proportion is small, and (2) the standard devia- 
tion depends upon the true proportion, are avoided by employing a new 
variable 0, which is a function of p. The function is chosen so that, first, 
6 is more nearly normally distributed than p, and second, the standard 
deviation of d is independent of the true long-run value of 6 or p. A 

• For a description of this device, see Fulcher and Zubin, “The Item Analyzer.’’ 
A model constructed by Dr. Fulcher was lent to the Statistical Ucsearch Group for 
trial in 1943. It proved quick and cosy to use and would be cheap to build, as it 
involves only plywood and celluloid. 
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function that meets these requirements when N is not too small is 

6 = 2 arcsin (Igj 

Unless N is very small, $ may be regarded as normally distributed; the 
standard deviation is l/'s/W when 6 is measured in radians or 57.S/\/iV 
when 6 is measured in degrees. The Zubin Analyzer is a mechanical 
device for transforming the proportions to the proper angles and reading 
directly the difference (6b — 6a). The required probability can then 
be read from a simple chart showing the difference and its standard error, 

vw.* 


3. NECESSARY NUMBER OF TRIAiS 

A method that is sometimes recommended for finding the required 
sample size in experiments involving double dichotomies is to set V in 
expression (14) equal to the value Va, which would be exceeded only a 
percent of the time if there were no true differences in the proportions, 
and then solve for N, using values of ps and p* obtained experimentally, 
The result is 

V - P^) + - T’g)] .iQ-, 

(P.-P.H ^ 

This procedure can be ma<le logically consistent by basing the calcula- 
tions on expression (15) instead of on (14), in which case the formula 
becomes 


Kl(p, + p,) (l - 

{pE - Ps)^ 


( 20 ) 


where is the normal deviate exceeded with probability a, as given in 
Table 1.1 of Chap, l.f 

In general, (20) solves correctly the following problem: If the propor- 
tion of successes is ps for the standard and pe for the experimental 
method, how large must be the number of trials from which these propor- 
tions w'ere computed before the experiment can be regarded as indicative 
of a real difference? The question stated is, how’ever, of little or no 
practical significance. The practical problem exists only because it 
cannot be assumed that the proportions shown in the experiment are 

* See Chap. 16 for an account of the inverse sine transformation for percentages. 

t The value of K2 can be found from tables of the chi-gqiiare distribution, for 
ex«.caple, Table IV in Fisher and Yates “Stottsiicol Tables, thus eliminating the need of 
squaring Ka. Since the probability that x* will exceed a certain level is the probability 
that X will exceed the square root vf that level the probability that — x will exceed 
the square toot of that level, the pcohs^bditics given in the x* tables must be halved 
for the present purposes, 
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the true proportions. If they were, M'e should be able to decide Anthout 
difficulty which method is superior. Furthermore, even if we were 
willing to accept the proportions px and pe shown in the experiment as 
suitable approximations of tlie true long-run proportions Ps and Pb, we 
could compute N from (20) only after carrying out the experiment to 
find ps and ps. 

To determine a useful formula for N, we must think of formula 
(11) or its equivalent, formula (15), as constituting a rule according 
to which w’e decide from the data which of two actions to take. If the 
formula yields a value above some predetermined critical'level, we accept 
the experimental method as superior, and if it yields a lower value we do 
not accept it (that is, for practical purposes we reject it). If the true 
proportion of successes for the experimental method is the same as the 
true proportion of successes for the standard method, it is important 
that the critical level of x be such that there is only a small probability, 
say ct, that the data will lead to a value of x above the critical level. 
Similarly, if the true proportion of successes is Ps for the standard 
method but Pe {Pe > Ps) for the experimental method, it is important 
that the critical level of x and the sample size N be such that there is 
only a small probability, say /?, that the data will lead to a value of x 
bclow’ the critical level. 

The first condition, that the probability be only a of accepting the 
experimental method as superior when the true probabilities of success 
are equal, is met simply by selecting the critical level of x as Ka, the 
normal deviate exceeded with probability a. Then, regardless of the 
sample size, the probability is a that the experimental method will be 
accepted when the true probabilities of success are the same for both 
methods. 

On the other hand, for small samples the probability that x ^vill 
exceed Ka will not be much more than a even when the true probabilities 
are Pa and Pe. This probability of accepting the experimental method 
when the true probabilities are Ps and Pb ■"'ill, however, inciease as the 
sample size increases; and the problem is to find that value of N for which 
it is 1 — /3- 

The required value of N, the size of the sample to be used Avith 
each method, is gi^'en by 


N = 


1 / Kg-S-Ks Y 

2 \arcsin — arcsin V^/ 

if angles are measured in radians, or by 

Ka + Ka 


N = 1641 


•K 


arcsin VK — arcsin 




(21) 


( 22 ) 
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if angles are measured in degrees, where is defined by 



a is the probability of an error of the “first kind,” that is, of accepting 
the experimental method as superior when actually the probability 
of success is the same for both methods 
^ is the probability of an error of the “second kind,” that is, of 
rejecting the experimental method when the true probabilities 
for the standard and experimental methods are Ps and Pb, 
respectively.* 


Values of V can be read directly from the nomogram of Fig. 7.1. 

The choice of Pa can usually be based upon previous experience with 
the standard method, which will indicate approximately its proportion 
of successes. The value of Pg may then be chosen enough above Pa so 
that the difference is one that it is important to detect when present, 
Moderate variations in the values of Ps and Pb are not serious if Ps and Pg 
are affected alike. If the angular difference, the square of which con- 
stitutes the denominator of formula (22), is accepted as the appropriate 
measure of the difference between two percentages, it is not necessary 
to choose Ps and Ps individually but only to determine the angular 
difference that sliould be detccted.f 

To illustrate the application of formula (21), suppose Ps * 0.010, 
Pg = 0,025, a = 0.05, and 0 = 0.10. From Table 1.1 of Chap. 1, we 
find Kt, « 1.645 and Ks = 1.282. From trigonometric tables,! we find 
arcsin 0.1000 and arcsin 0.1581 to be, respectively, 0.1002 and 0.1588 
radians. Substituting these figures into (18), we have 


^ ^ (1.645 + 

2(0.1588 - 
= 1,246 

• If only one method is involved in un experiment, and if it is desired that the 
probability oi approving it be a or 1 — 0 according as its true probability of succc&s is 
Ps or Pb, (21) will indicate twice the appropriate sample size; that is, the 

appropriate sample size is given by substituting 4 for 2 in the denominator of formula 
(21). This was the method of computing the sample sizes No given in Table 1.3 of 
Chap. 1 for acceptance-inspection plans based on attributes. For that application, 
the first sentence of this footnote should be changed to read as follows; If only one 
product is involved in an inspection plan, nnd if it is desired that the probability of 
reiecting be a or 1 — ^ according a.s the true probability of a defective is p, or pi, 
formula (21) will indicate twice the appropriate sample size. 

t In this connection, see Statistical Research Group, Sequential Analysis, Sec. 
3-62, pp. 3.47—3.50, especially Table 3.61 and Fig. 3.61; also Secs. 3.21 and 3.22, pp. 
3.0^3.10. 

X For example, Mathematical Tables Project, Arc sin x. 


1.282)’ 


0 . 1002 )' 


(24) 
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If the nomogram is used, we pass a line between 0.05 on tbe a scale and 
0.10 on the ^ scale and mark its point of intemeotion with the A scale. 
Another line is passed between 0.01 on the Ps scale and 0.025 on the Pj 
scale, and the point of intersection of this line mth the B scale is marked. 
The N scale is calibrated so that the number of trials needed for each 
method can be read off where the N scale is intersected by a straight 
line between the points marked on the A and B scales. In this example, 
the point of intersection falls about halfway between N ~ 1,200 and 
N = 1,300. 

4. OPERATING CHARACTERISTICS 

Conclusions draAvn from double dichotomies depend upon two quanti- 
ties, one characterizing tbe amount of data collected and the other 
characterizing the method of analyzing the data. These quantities 
are N, the number of observations with each method, and Ka, the critical 
level of X which, if equaled or exceeded, leads to acceptance of the 
experimental method as sui>crior. Formula (21) can be used to deter-, 
ttiitie the operating characteristics of any plan for analyzing a double 
dichotomy defined by given values of N and Ka. 

By the operating characteristics of a plan is meant the probability, 
as a function of the true nature of the populations, that the plan will 
lead to accepting the experimental method as superior. In this case, the 
operating characteristics may be represented by a surface rather than a 
curve, for the true nature of the populations is measured by two param- 
eters Ps and Ps- If in the plane of tlie page we measure Ps lengthwise 
and Ps crosswise, any point for w'hich Pb and Ps are both between 0 and 1 
represents a possible combination of Pz and Ps. Vertically above each 
point we may erect a line whose height represents the probability that a 
test using the given N and Ka \vill lead to accepting the experimental 
method as superior. The surface formed by the tops of these lines is the 
OC surface. A test is satisfactory if its OC surface show’s high probabili- 
ties of accepting the experimental method when its superiority is suffi- 
cient to make such acceptance important, and low probabilities of accept- 
ing the experimental when its superiority is so small (especially when it 
is zero or negative) as to make its acceptance undesirable. 

We may rewTite (21) us 

— Kff = Ka — (arcsin \/Pb — arcsin ^/F^) (25) 

Formula (25) yields —Kg; the probability of accepting the experimental 
method is 1 — /3, which is the probability that a normal deviate will 
exceed —Kg and may be obtained from Tabic 1.5 of Chap. 1. Thus, for 
any combination of Pg and Ps, formula (25) yield.s the probability that a 
test based on. N and Ka wdll lead to acceptance of the experimental 
method. 
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Formula (25) does not depend upon the individual probabilities 
Pe and p3 but only upon their angular difference 

7' = arcsin — arcsin y/?s (26) 

so we may write it 

r - (27) 

Letting Lt denote the probability that a test defined by N and K„ udU 
lead to acceptance of the experimental method when the true angular 
difference is T, and noting that Ki-^ ~ we have 

== f e"2 (ix (28) 

V 2ff J Ka- \^2N T 

^ as the equation of the OC curve in terms of T. Values of Lt can be 
obtained from Table 1.5, Chap. 1, by taking 

K. - - \/2JV T (20) 
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Figure 7.1 can be used to determiTie ij- from (28). The given values 
of Pe and Ps determine a point on the B scale. A line is drawn through 
the point on the B scale and the given value of N on the N scale and 
extended until it intersects the A scale. This point oil the A scale and 
the given value of a on the a scale determine a line whose intersection 
with the /3 scale gives 1 — Lt. 

In evaluating a proposed test, it is sometimes helpful to plot the OC 
curve .against the true proportion of successes for the experimental 
method, assuming some value, sayP^, for the proportion of successes with 
the standard method. This gives a picture, the significance of which 
depends on the validity of the value used for P'^, of the absolute level 
of performance by the experimental method that will result in a high 
probability- of its acceptance or rejection. Such a picture can be obtained 
from formula (25), replacing Ps by Pg and calculating Lt = 1 — ^ 
for various values of Pe. 

Figure 7.2 shows the OC curve for an analysis based on a sample size 
N of 500 for each method and a critical level of x. Ka, of 1.645. Two 
horizontal scales are shown, the lower in terms of T, the true angular 
difference between the two probabilities, and the upper in terms of Ps 
on the assumption that Ps = 0.10. 


6. TECHNICAL NOTES 

Let Se and Ss be the obseiw'ed numbers of successes in N trials with 
the experimental and standard methods, respectively. Then the 
observed proportions of succe.sses with the two methods are 


Sb 

P'-jV 


and 


Ps = 


Ss 

N 


(30) 


When w'e are interested only in alternative hypotheses for which 
Pe, the true proportion of successes with the experimental method, is 
greater than Ps, the long-run proportion of successes with the standard 
lueLliod, the classical test with level of significance a is to reject the null 
hypothesis that Pe = Ps if 

\^(Pe — ps) 


w'hcre 


(Pe + ps) 


> Kr, 




^ dx = 


(31) 


(32) 


Except w'hen N is very small, or Pe or Ps very close to 0 or 1 , this 
test is essentially equivalent to the criterion: Reject the null hypothesis if* 

(arcsin y/ps — arcsin -y/ ps) > A, (33) 

* See Chap. 16 for a discussion of the inverse sine transformation of percentages, 
'upon which what follows is based. 




CHAPTER 8 


PLANNING AND INTERPRETING EXPERIMENTS 
FOR COMPARING TWO STANDARD DEVIATIONS 

PAae 

1. Iiiiroduction 269 

2. Experiments to Determine WTiether a New Product la More Variable Than a 

Standard Product 269 

2.1 Problem 269 

2.2 General Procedure for Baaing an Answer on Observational Data 270 

2.3 Standard Procedure 270 

2.4 Operating Characterietics of the Standard Procedure 271 

3. Experiments to Determine Whether a New Product Is Less Variable Than a 

Standard Product 278 

3.1 Problem 278 

3.2 Illustration 280 

4. Experiments to Determine Whether a Particular One of Two New Products Is 

More Variable Than the Other 280 

4.1 Problem 280 

4.2 Standard ' :edure When l*roduct I Is to Be Chosen Unless ff\ Is Larger 

Thane 28l1 

4.2.1 Procedure 281 

4.2.2 Two Special Cases 282 

4.2.3 lUustrations 283 

4.3 Procedure ^Tien It Is Immateri^ Which Product Is Chosen If c] ^ . 2S3 

5. Experiments Involving the Analysis of Variance 297 

5.1 Systematic and Random Variation 297 

5.2 A Typical Analysis of Variance 311 

5.3 Illustrations 313 

6. Technical Notes 314 

6.1 Method of Construction and Accuracy of Tables 8.1 and 8.2 314 

6.2 Method of Construction and Accuracy of Tables 8.3 and 8.4 . . . 316 

7. References 318 



268 


TECUNIQUES OP STATISTICAL ANALYSIS 


Chap. 8 


PIGUHES 

8.1 Operating-characteristic Curves for Experiments to Determine Whether a 


New Product (Process) Is More Variable Than a Standard Product 
(Process) of linown Variability, 0.05 Level of Significance 274 

8.2 Operating-characteristic Curves for Experiments to Determine Whether a 

New Product (Process) Is hlore Variable Than a Standard Product 
(Process) of Known Variability, 0.01 Level of Significance 275 

8.3 Operating-characteristic Curves for Experiments to Determine Whether a 

Particular One of Two New Products (Processes) Is More Variable Than 
the Other, 0.05 Level of Significance 296 

8.4 Operating-characteristic Curves for Experiments to Determine Whether a 

Particular One of Two New Products (Proceraes) Is More Variable Than 
the Other, 0.01 Level of Significance 297 

TABLES 

8.1 Values of p(0.05,/9,ni) Corresponding to Selected Values of /3 and n\ 272 

8.2 Values of p(0.01,fi,n0 Corresponding to Selected Values of 6 and ... . 276 

8.3 Values of 0(O.O5,/3,ni, ns) Corresponding to Selected Values of 6, m, and TVj, . 284 

8.4 Values of «(0.01,/3,ni,ns) Corresponding to Selected Values of nj, and n* . 298 


This chapter was prepared by 
Churchill Eisenhart, National Bureau of Standards 



CHAPTER 8 


PLANNING AND INTERPRETING EXPERIMENTS 
FOR COMPARING TWO STANDARD DEVIATIONS 

1. INTRODUCTION 

The present chapter is concerned with the planning and interpretation 
of experiments to determine whether (1) a given product, or process, 
is more (or less) variable than a standard product, or process; (2) one 
of two new products, or processes, is more (or less) variable than the 
other; (3) the random variation of a product, or process, has a component 
assignable to a specific source of variation. 

With regard to proposed experiments, the problem considered is 
that of determining how many observations will be required in order to 
render tlie discriminating power of the experiment adequate for the 
purposes at hand. The solutions to this problem, in addition to being 
useful in the planning of experiments, provide a mcau.s of evaluating the 
discriminating power of an experiment already carried out. Thus, in 
planning experiments for the three purposes listed above, the results 
given below' will enable a research worker to formulate an experiment the 
size of which, on the one hand, is compatible with the cost (monetary 
expense, time, inconvenience, and so forth) of obtaining the observa- 
tions and, on the other, limits to a known extent the risks of making 
erroneous decisions of practical significance. Alternatively, in the case of 
experiments already conducted, the results given below' will enable the 
experimenter to judge the confidence that he can place in conclusions 
based on the data obtained. 

2. EXPERIMENTS TO DETERMINE WHETHER A NEW PRODUCT 
IS MORE VARIABLE THAN A STANDARD PRODUCT 

2.1. Problem 

The following situation is common in practical work : A certain product 
has been in use for some time and its variability wdth respect to some 
important measurable characteristic x is known. Let o-q denote the 
knowTi variance (squared standard deviation) of x for this standard 
product. A new product is under consideration, whose variability with 
respect to x is unknown; let af denote the unknowm variance of x for the 
new product. Since the value of <Ti is unkno^vn, it is not possible to 

269 
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decide with certainty whetlier the variability of the new product is more 
than that of the standard, that is, whether > 1 . 

2.2. General Procedure for Basing an Answer on Observational Data 

An answer to this question can, however, be obtained by computing 
an estimate s? of o-f from values of x observ'ed in a sample of the new 
product and agreeing that > C will be taken to imply that ctx/o'o > 
and Si/tT^ < C will be taken to imply that <ri/<r§ < 1, where C is some 
positive constant chosen in advance, that is, before the value of s? has 
been obtained, preferably before the experiment determining the value 
of sj js carried out. It is evident that if C is very large, application 
of this procedure will almost always lead to the decision that the new 
product is not more variable than the standard {ff\ < <7-|) ; if C is very 
small, the decision will almost always be that the new is more’ variable 
than the standard (<ri > <r§). Clearly, some intermediate value of C is 
called for — a value that will not lead too frequently to the decision 
<^iAo > 1 when the reverse is true and yet will lead to this decision in 
mo.st of the cases in which the excess of c\ over cl is of practical 
importance. 


2.3, Standard Procedure* 

The standard procedure is to use as an estimate of cl a function 8\ 
of the observed values of x that has the property that in repeated sampling 
ni$l/cl ia distributed, at least to a good approximation, as x* for n 
degrees of freedom, and to ^ 
a. Conclude c\/cl < 1 whenever 


fi < 

cl ~ rit 


( 1 ) 


b. Conclude cl/cl > 1 whenever 


£i xl(ni) 


(2) 


ao fix 

where Xe(n]) is the a level of significance of x‘ for ni degrees of freedom, 
that is 

a = P{x^{ 


I /”" /l 


(3) 


for n = ni.f 

* See Fisher, Statistical Methods, Chap. IV, See. 21.03. (For full citations, see 
Sec. 7). 

t See See. 6, below, for a discussion of published tables of this integral. y 
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Example 1. The variance of a particular dimension of a 
standard product is 3.2 cm.* From measurements of the dimension 
on 10 items of a nev’ product it is found that s? = 4.8, with 9 degrees 
of freedom. Does the variance of of the dimension T^dth the new 
product e.'tcccd the variance erg of the dimension with the standard 
product? 

If we conduct the test at the 0.05 level of significance, we find 
siAo ^ 1-5 < 1-880 = Xo.o 5(9)/9 and are led to conclude a\Jal < 1; 
that is, we conclude that the variability of the new product does not 
exceed the standard in respect of the dimension in question. 

2.4. Operating Characteristics of the Standard Procedure 

The question arises, what are the chances of the standard rule leading 
to a ^vTong conclusion? That is, when in fact a\la\ ^ 1, how often will 
it lead to the conclusion <r|/<rg > 1, termed an error of the first kind;* 
and when in fact (tJA? > 1, how often will it lead to the conclusion 
afAg < 1, termed an error of the second kind? In other words, what 
are the operating characteristics of the procedure? 

Clearly, the chance of an erroneous decision will depend on trg, 
ni, and a, as these quantities are involved explicitly in incciualities (1) 
and (2), Intuition tells us that the chance of error depends also on 
the actual value of <rj/<Fo, that is, upon 


To begin with, it Is clear from (3) that the probability of an error of 
the first kind is exactly a when p => 1. Second, it will be shown in 
Sec. 6 that the probability of an error of the second kind will be 
exactly /3 if p has the value 

, .. , xl(ni) . 

p(a,ff,ni) = - Y - y -T (5) 

This equation has been used to compute tables of corresponding 

to a = 0.05 and 0.01 and to a wide selection of values of /3 and nj. These 
are published as Tables 8.1 and 8.2, pp, 272-273 and 2/G— 277 ; the method 
of their construction and the accuracy of interpolation is discussed in 
Sec. fi. 

The following examples illustrate the use of Tables 8.1 and 8.2 in 
the interpretation of the results of experiments already carried out 
and in the planning of experiments: 

Example II. For what value of the ratio trf Ao 'S the probcability 
of an error of the second kind equal to 0.50 when the tost of Example 
I is employed? 

• This terminology was introduced by Neyman and Pearson. 



TABLK 8.1 

Values of p(0.05,ftnt) CoMESPONiUNfi to Selected Values of ^ and n. 


272 


TECHNIQUES OF STATISTICAL ANALYSIS 


Chap. 8 


u^oocoQooeoot^co 

CQcaQeQOt^a>0-^04 

^u5®®eOcoor>»b-t» 


Q 0> W M 

w OJ «o N b- c5 

^ ^ IfJ to «D c» 

t» t» t- fr- b* b- 


OWfO^b--- 

t» lO O W to 

[» (7D 00 CS OS 

fr- b* b» b» 


OOPOOOOOOOOOOOOOOOOOOOO 


OsOClOOCOO^PC»aOOOOcOOO'4'COb>u)0?'"iMOt- 

aSOC 0 ’>J'«C 4 *-''^O 06 u 5 C^P»PJb»'-"W 0 >C^t 003 C^^ 

t..io5o-^F>'W<toi^*o6o30p — «iN«««oort't-T 

iOtOtOb»b»b«b»l~b-b-r»OOOOOCWOO«OOoOOOCOCOi:* 

O O O O O O O C> O O O O O O o O O O O O O O o 


tO'-io^r^-^so^rTt - - 

(..cocccoaOQOcoaDobCiocio 


S ppp-- — 

p Os P 0) Cs Cs Cs Os Os Cs Os 


soooooooooooooooooooooo 


9 

o 


OOO^tOtCOSOtOMf-iOSsOb-, 
cs.— OOSCiOC<OObl»C(X)C>3o04'Ob-CO 
— (0*0 — OSOe»^-CD^O•«'«COC^^JN« — 

•^rtMC^.— >— -Hi-it—rlrt— 1 — — I— 


^ ^ p 00 OO 


*0 N O 05 

O 03 *3 M — 00 

— O O O O Cs 

*— ^ 


OsOiNQOoOOSOirjtOOs — 
C'l-—M'HO*Ot£ib.*C'OOp 

S tsptcr-" ‘ 

— ® t- tc 


OS b) N W OS 


•o— loouoco — S>o6t-*j?>^co?3 — — oos 




oscsp*Oi--i‘<»«rt©i:rtD — 
M-«e5p.'«'-+so-HOO<3sc^'^i^*ort^ 

— .>-vXcooOb*b»'^ 


g 

d 




M5 O 


© OS 


— — — — T- — — 


©Q — OS — <« 90 <««t ^00 

■ aMii 9 >^©*^p 4 O 00 t— 9 — — 

rt-'’T'<o«^Oo©— ■csos© 

CC'^n'© — ©C5©00b-«O^»»>.v — WWW-. V 


d 


M 00 t- © — «» . 
“ .A « Cs 0^ b» 


•.♦•Aoo 
b» lA SA 
^ © OS CA I- 


S ^ bs 


IS p; 5 g 

•O 00 N © — 




^W©00f— P^©b»©*v"“wv»wv«— 

codcod*A--»-d-Ter>wddddddc4ddddd 




*A ^ . -- 

3 — © '!' © O -.t . . 

— ^ O OS © b- 00 

■.fOttfO©©-^'©© 


00 t> L*. © — 

— O © OO CC N 


S5 


■.** eo 
© 00 o t* 

— oo w . 

c^toto— 'cc — e^© — 


WCOiOPOOOOO— 'lA 
<30©-^-3*b.w©b»t— 
©eo*0b»00©0*}'0 
■■ ■ .>»> OS © ISO © *A 


S *S b. © 
t- b» 00 
SA 1-1 o 


»»'«>b»00«(»fO©«>5CO*OC<©Tf'ir5lA©b]bliA© 
b.iA«b-e0*0 — OiA'tOO'^OOb-bSO’-'^Ob.iAV 
©©©©■^coTf — — .«JioO'i»Ob.*Aco-H©o 6 ©« — 




00 CO 


— — ®l50b.©iOlOlf5*!j<"t}1'«l<*<i1COWeOP5CC 

fv w — — 


OOOQ'5'Ob-OOOOC<C^'»<COb»b*M 
t-*t*©lOC< — OTOC^O^'NOTOSCO — *f3©iOOD 
oocobseo'coio^t-— «— '—©oc^©^© 


ooOMior'it‘»OaONaO''3< 


OO O 'f OS o 


s 

& 



s s 

bd o «= 


-HWCOMiuOtOli-OO©© 


W b5 .Ip *A © b" 



TABLE 8.1. — {Continued) 


Txble 8.1 


COMPARING TWO STANDARD DEVIATIONS 


27S 





a 


A 

.•tf 

"a 



% 

£ 


a. 

K 

X 


u 

5 



.2 ® 


.3 ® 



\ 













274 


TKCHNIQUEvS OP STATISTICAJ, ANALYSIS 


Chap. 8 


For a = 0.05, iti = 9, and = 0.50, we find from Table 8.1 
that p(0.05, 0.50,9) = 2.0280. This means that if al is roughly 
double <Tft (that is, if the standard deviation of the new product is 
roughly 1.4 times that of the standard) and the test is conducted at 
the 0.05 level of significance ^with sf based on only 9 degrees of 

.OS' Level of Significance 



Fia. 8.1. — Operating-characteristic curves for experiments to determine whether a 
new product (process) is more "variable than a atnndard product (process) ol known vari- 
ability, 0.05 level of signifiesneo. 


freedom, then there is approximately an even chance that the test 
will lead to the wrong conclusion, <rj/<r5 <1. If, to ensure a smaller 
risk of committing an error of the first kind, the test i.s conducted 
at the 0.01 level of significance, the situation is worse, for 

p(0.01,0.50,9) = 2.5970 

(from Table 8.2). Clearly 9 degrees of freedom for s? arc too few 
if a decision that < 1 is a Mrious error from the practical 

viewpoint when v} is double oq. 

Example III. If a decision that vi/vo < 1 is a serious error 
from the practical viewpoint when ai = l.Svo (p = 2.25), and it is 
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desired to keep the risk of such an error below 0.05 (/3 = 0.05) 
when the test is conducted at the 0.05 level of significance (a = 0.05), 
how many degrees of freedom will be needed for s?? 

On looking in the 0 = 0.05 column of Table 8.1, we find that 
Til = 30 is not qiute sufficient, since p(0.05,0.05,30) = 2.3670; but 


.01 Lev«l of Significanco 



Fig. 8.2. — Operating-characteristic curves for experiments to determine whether a new 
product (process) is more variable than a standard product (process) of known variability, 
0.01 level of significance. 


Ml = 40 is ample, since p(0.05,0.05,40) = 2.1034. By interpolation, 
using l/v^ ns argument, it is found that 34 (33.7) degrees of 
freedom are needed (linear interpolation gives 34.4, which would 
be taken, as 35). 

If <ro = 1.79 cm. (ffl = 3.2 cm.*) as in Example I, so that 
(Ti = 1.5ao = 2.09 cm., and it is felt that this is too large an excess to 
have undetected 1 time in 20, but failure to detect that <ri >‘ao 
when <ri = 2.00 cm., say, could be tolerated 1 time in 20, then 
p = 1.25, and it is clear from an examination of Table 8.1 that a 
very large number of degrees of freedom, over 400, are needed — 
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an astonishingly large number to persons who have never investigated 
this matter before.* 

As is pointed out in the footnote to the tables, p(a, j8,ni) is the value 
of (s\ia\ for which the probability of the dec^ion a\]a% < 1 equals /3 when 
the test is conducted at the a level of significance with n\ degrees of 
freedom. When < 1, can no longer be interpreted as the 

probability of an error of the second kind, since the decision a\la\ < 1 
is correct under these circumstances. f The values of < 1 have 

been included in the tables since they are useful for drawing the operating- 
characteristic curves. 

Let Lp = L(a,ni,p) denote the probability that the decision < 1 
will be made when = p and the test defined by formulas (1) and (2) 
is conducted at the a level of significance with ni degrees of freedom 
for si- Then Lp plotted as a function of p, for fixed values of a and Ui, 
is termed the operating-^hatacterisUc eurve of the test so defined. Since 
the probability that the decUion <r|/<T§ > 1 will be reached is 1 — Lp, in 
view of the exhaustive character of inequalities (1) and (2), it is clear 
that the curve Lp completely specifies the operating characteristics of the 
test, that is, the expected performance of the test in repeated applications, 
TIius, it is not necessary to plot the coinplementajy curve 1 -Lp, except 
perhaps for psychological reasons. A probability of 0.90 that a correct 
decision will be made may evoke leas concern about the stringency of the 
test than a statement that the probability of an incorrect decision is 0.10. 

Figure 8.1 shows the operating-characteristic curves correspond- 
ing to 5, 10, 15, 20, 30, 40, 60, and 120 degrees of freedom when 
a — 0.05; Fig. 8.2 shows the corresponding curves when a = 0.01. 

3. EXPERIMENTS TO DETERMINE 'WHETHER A NEW PRODUCT 
IS LESS VARIABLE THAN A STANDARD PRODUCT 

3.1. Problem 

There are not many situations in which a new product is preferred to 
a standard product only if its variability exceeds that of the standard. 
Con.sequently, a test of the hypothesis vf/ao ^ 1 relative to the altema- 

• The following formula may be used when » is large, say more than 30: 

„ ^ * 

2 \ <ri — tfo / 

_ 2 ( Kg + Kff Vp \» 

2V - 1 / 

where Kt denotes a normal deviate exceeded with probability « and may be found from 
Table I.l of Chap. 1. 

t From (6) it is clear that p(a,/5,r»i) « 1 for 3 = 1 — and is less than 1 for 
jS > 1 — since x« increases as < decreases, whatever the value of n. 
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tive c\l<j\ < 1 is rarely employed. Nevertheless, there are situations 
in which too small a variability is disadvantageous. For instance, an 
average gunner is more likely to bring down a bird with a shotgun than 
with a rifle. It would not be advisable to reduce the dispersion of the 
shot to nearly zero. 

In such cases the standard procedure is modified to 
(a) Conclude > 1 whenever 


ffl ~ rii 


( 6 ) 


(b) Conclude a\/al < 1 whenever 


i xU(ni) 

al n, 


(7) 


In connection wTth this rule, the decision < 1 when in fact o-j/(t§ > 1 

is an error of the first kind, whence the maximum value of the probability 
of an error of the first kind is «, which is the probability of the decision 
ffl/cl < 1 when <rf/<ri » 1. Accordingly, the statistical test defined 
by (6) and (7) is said to be conducted at the a level of significance, 
although xi-«(wi) is the 100(1 — a) percentage point of for degrees 
of freedom. 

The value of p' = for which the probability of a decision 

> 1 equals 0 when the test specified by inequalities (C) and (7) is 
employed is readily shown to be 

, / s Xi— men'll 

- I 

Consequently, values of p' are found by interchanging a and 0 and taking 
the reciprocal of the corresponding p. Thus 


P'(0.05,0,05,«.) - o 

(9) 

and 


p'(0.01,0.05,n,) - ^(0 05 0 0 , 

(10) 

can be obtained from Table 8.1 by taking reciprocals of the relevant 

entries; and values of 


p (0.01,0.01, ni) p(o.01,0.01,«i) 

(11) 

and 


p (0.05, 0.01, n,) p(o.oi,0.05,ni) 

(12) 

can be obtained in similar manner from Table 8.2. 
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3.2. BlustratioiL 

Example IV. The scores of students taking a standard examina- 
tion have a standard deviation of 20 points (<ro = 20). An untried 
examination will be acceptable if with it students' scores have a 
standard deviation not Jess tlian 20 points (al/co ^ 1)» and the 
authorities are willing to accept a risk of 0.05 (a = 0.05) of errone- 
ously rejecting an examination for which cn = vo = 20. On. 
the other hand, acceptance of an examination for which tri = 10 
(f>' ~ Vi) would be a serious error, and it is desired to hold the risk 
of such- aji occurrence below 0.01. ITow many students will be 
needed in a preliminary tryout of the e.xamination ? 

For a — 0,05 and ^ = O.Ol, we seek the value of rii for which 
p'(0.05,0.01,?ii) is 0.25, that is, the value ni for which p(0.01,0.05,«i.} 
is 4. In Table 8.2 wc see tJiat 

p(0.01,0-05,I6) = 4.0193 (13) 

p(0.01,0.05,17) = 3.8526 (14) 

Accordingly, tii > 17 will be required, which means that the smallest 
number of students (ni 4* 1) that will sulBce is 18. 

4. EXPERIMENTS TO DETERMINE WHETHER A PARTICULAR ONE 
OF TWO NEW PRODUCTS IS MORE VARIABLE THAN THE OTHER 

4.1. Problem 

When the variance of the measurable characteristic is unknown for 
both products, as it generally is when both are new, the rules of procedure 
given in Secs. 2 and 3 cannot be applied. Let <r| denote the true variance 
of the measurable cliaracteristic in the case of product I, let al denote the 
variance in the case of product II, and let s* and sf denote estimates of 
al and ^2 computed from measurements on 1 and II, respectively. A 
choice between the conclusion ^ 1 the conclusion > I 
can then be based on the observed values of sf and ^1, for example, on 
the observed value of their ratio sl/sh That is, it may be agreed in 
advance that either the conclusion vf/vf > 1 or the conclusion <rf/cr| < 1 
will be accepted according as «i/«l e.xceeds or does not exceed some 
number C chosen in advance. 

In selecting C it is necessary to distinguish between the following 
two situations: (1) For various reasons (for example, cost, convenience, 
and so forth) product I is preferred a priori and should be chosen unless 
<t] is substantially larger than <r|. (2) Product II is to bo chosen if 

c\ > cl, but it is immaterial which is chosen, when a® = <r|. 
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4.2. Standard Procedure When Product I Is to Be Chosen Unless <Ti Is 

Larger Than oi 

4.2.1. Procedure. — The standard procedure in case (1) is to compute 
from the data estimates sf and s| such that in repeated sampling riisl/cl 
and nisy<j\ be distributed independently as for ni and n 2 degrees 
of freedom, respectively, and to base the choice on the following rule: 

(a) Accept product [ whenever 

I < (IS) 

(b) Accept product JI whenever 

U > F^iuiynz) (16) 

where Fa(ni,n 2 ) is the a level of significance of the variance ratio dis- 
tribution 


a = P[F(ni,ni) F„(ni,ni)] 



Since, under the assumptions regarding the distribution of s\ and s|, 
the ratio («i/«j'i)/(52/<t|) is distributed as F for ni and ng degrees of freedom 
whatever the values of <tI and «r|, it is clear from (17) that the probability 
of (16) occurring when <r^ = is exactly a. 

Accordingly, if choosing product 11 when its variability is not less than 
that of product 1 (that is, when < 1) is termed an error of the first 
kind, clearly a is the maximum value of the probability of an error of 
the first kind when the standard procedure is followed and the distribu- 
tions of and are as assumed. The test is thus said to be conducted 
at the a level of significance. 

Let the true value pf the ratio be denoted by 


Then it is of interest to determine the value of <f> for which the probability 
is $ that product I will be chosen by application of (15) and (16). The 
answer is readily found from the relation* 


• Shortly after this formula was derived, a British document was received in which 
essentially the same formula is given and attributed to D. V, Bindley; see Baij^es, 
Economical Design, 
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= FJ^niytii) • Fii{ni,ni) 


(m 


Extensive tables of <^(a,/3,ni,ns) corrtsponding to a = 0.05 and O.Ol and 
to a range of values of ni, and Ui are presented as Tables 8.3 and 8.4, 
pp. 284r-295 and 298-309. The use of formula (19) in. the computation 
of these tables is explained in Sec. G, which also includes a discussion of 
methods of interpolation. Figures 8.3 and 8.4 show the operating-charac- 
teristic cur\’’es plotted from the tables, for Ui = ua « 5, 10, 15, 20, 30, 40, 
60, 120. 

4.2.2. Two Special Cases. — Before illustrating the use and interpreta- 
tion of Tables 8.3 and 8.4, we may notice two important special cases 
nvolving = n^: 

{a) IVhen Ui — = n and 0.50 


Eo.5o(n,n) = I 

lor all values of n, whence 


( 20 ) 


4'(a,0.50,n,n) = Fa{n,n) (21) 

In other words, when the degrees of freedom for s\ and are equal, the 
probability of an error of the second kind is ^2 when 
the critical ratio employed in the test. Thus Fa{n,n) may be termed the 
indifference value of <rf/<r|, that is, the value of c \/< j \ fop which the test 
is equally likely to select either product. 

(6) IVhen ni » nj * n and ^ — a 

^(a,tt,>i,n) = E<,(a,n) (22) 


In other words, when the degrees of freedom for and si are equal, the 
probability of an error of the second kind is a when ai/aa, the ratio of the 
true standard deviations, equals n), the critical ratio employed in 
the test. That is, the risk of an error of the second kind when cj/ws ^ 
Fa(n,n) is the same as the risk of an error of the first kind when o-i/cj == 1 . 


4.2.3. Illustrations 

Example V' A choice between two products i.s to be made, the 
relative variability of the tw'o products being relevant but of second- 
ary importance in the sense that it is immaterial which is chosen if 
al/al = 2, product I being preferred if <j\/xr\ < 2, product II if 
o\lo\ > 2. If the choice is to be based^ on (15) and (16), using the 
0.05 level of significance (« = 0.05), and if and s| are to be based on 
an equal number (nj = m = n) degrees of freedom, how many 
degrees of freedom will be needed for each, and for what value of 
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the probability 0.95 that product H will be chosen 0 = 0.05)? 

From the first special case of See. 4.2.2, u’e have 

0(0.05,0.50, n,n) = Fa.^h{n,n), 

and from tables of the F distribution we find this to be 1.9838 when 
n = 24. Thus, if 24 degrees of freedom are used for each product, 
th$ probability that product II will be chosen is 0.05 if (Ti/o-j = 1,0.50 
if 0^1 Al = 2, and (according to case (b) of Sec 4.2.2) 0.95 if cl/al = 4. 

Example VI. If only 30 degrees of freedom are available for s? 
and if a test is conducted at the 0.05 level of significance, how many 
degrees of freedom m'H be needed for in order to ensure that the 
probability is only 0.05 of product I being chosen when tri/rj = 1.5? 

The desired stringency cannot be achieved, since Table 8.3 shows 
0(0.05,0.05,30,00) = 2-367, which exceeds o-fAl = 2.25. 

4.3. Procedure When It Is Immaterial Which Product Is Chosen If 

ff? = 

This situation arises when variability is the primary basis for choosing 
between two products. The follomng rule is appropriate to this 
situation: 

(a) Accept product I whenever 


~2 ^ Fo.6o(fii,ni) 

(6) Accept product II whenever 

> F 0,5o(W|,W!) 


(23) 


(24) 


where Fo.so(wi,n 2 ) is the median of the F distribution for ni and ns degrees 
of freedom. Note that Fo.3o(ni,ns) ^ 1 unless fti = ns. 

By setting a = 0.50 in (J9), it is readily seen that when the choice 
is based on (23) and (24) the probability is jS that product I will be chosen 
if 


^ = 0(0.50, ns) 
<^2 


Fn.io(ni,ns) 

F i-p{ni,ns) 


(25) 


Conversely, the probability is 0 that product II will be chosen wlieii 


0(0.60,1 — 0,ni,ng) 


F 0.5o(^l>W2) 
Fff(ni,ns) 


( 20 ) 
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Since, under the circumstances assumed, the assignment of the 
designations I and II to the products is arbitrary, it is natural to require 
that (26) be the reciprocal of (25). For this to be the case, it is necessary 
that 

PS.Bo{n.,">) = ■ F,^(n,,n,) = (27) 


05 Level of Significance 



Fio. 8.3. — Operating-charuet^ristic curves for experiments to rietormine wliother a 
particular one of two new products (processes) is more variable than the other, 0.05 
level of significaoce. 


It is clear that when rii =* ns, equation (27) holds for every value of 
it is believed that the condition ni = ns is necessary for the equality 
to hold. Consequently, if symmetry of action, is considered desirable in 
the situation considered in this section, the test should be carried out 
with the same number of degrees of freedom for s? and 
Values of 

<^(0.50,(3,n,n) = Fp(n,rt) = <^(/3,0.50,n,n) (28) 

can be obtained from Tables 8.3 and 8.4 by means of (27). For example, 
.^>(0.50.0.06, 30, 30) = ^(0.05,0.50,30,30) » 1.841, from Table 8.3. 
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6. EXPERIMENTS INVOLVING THE ANALYSIS OR VARIANCE 

6.1. Systematic and Random Variation 

^^any experiments are analyzed by a technique (due to R. A. Fisher) 
known as the analysis of variance.* Tables 8.3 and 8.4 arc useful in 


.01 Lev6l of Sigrttficdfico 



Fio, 8.4. — Operating-characteristic curves for experiments to determine whether a 
particular one of two new products (processes) is more variable than the other, 0.01 level 
of slgni&cance. 


planning a certain class of such experiments, namely, those for detect- 
ing and measuring components of random variation. 

The factors associated with the variation of a product can be divided 
into two categories'. 

(1) There are factors that introduce random variation. Lack of 
perfect control at some stage of a production process often acts in this 

* Excellent accounts of the analysis of variance, which are especially pertinent to 
this chapter, are given by Baines, Economical Dcs^n, and Daniels, “Components of 
Variance.” 
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manner, and the material produced exhibits an inherent random vari- 
ability. This random variation may have assignable components. For 
instance, the thickness of Avashers punched from a single sheet may be 
regarded asVarying at random about the mean thickness of washers from 
that sheet, because of the inherent nonuniformity of the sheet; and 
washers produced during a given shift may have still greater variation 
about the mean thickness for the shift, because of an additional compo- 
nent of v’ariation assignable to the random variation of the mean thick- 
nesses of the respective sheets about the over-all mean thickness of the 
sheets on that shift, and so forth. » 

(2) There are factors that introduce systematic variation. For 
instance, in a production unit composed of several similar machines 
producing the same product simultaneously, there are generally sys- 
tematic differences among the machines, which superpose a pattern of 
variation on the output of that production unit. 

In using analysis of variance merely to determine whether the 
over-all variation has a component assignable to a particular factor, the 
computational procedure and the mechanics of the statistical test are 
the same in the case of a factor that may contribute a component of random 
variation as in tlie case of a factor that may contribute a component of 
systematic variation. On the other hand, in planning such investiga- 
tions and in the estimation of the magnitudefs) of the coinponerit(s), 
the distinction has to be taken into account, since the situations between 
which discrimination is required differ in the two cases, leading to 
differences in the computation of probabilities of errors of the second 
kind. We consider only cases u'licre random variation alone is present. 

The question arises as lo how to decide in a given case whether a 
component of variation is systematic or random. The answer depends 
upon the extent to which the experimental procedure samples the material 
at random. If a sampling operation is such that each item of the 
population has an equal chance of being included in the sample, and 
separate drawings are independent except for any dependence resulting 
from the number of items in the population being limited, then the 
sampling is random and the sample may be termed a random sample.* 
When an experimenter selects, two or more treatments for comparison 
in some respect, he rarely, if ever, selects them at random from a popula- 
tion of possible treatments; he selects those be believes most promising. 
Accordingly, components of variation assignable to differences between 
treatments are systematic. On the other hand, when an experimenter 

• It is important to note that it is the operation of drawing the sample that is 
random and not the sample itself, since any sample whatsoever can be obtained by 
either a random or a nonrandom operation. 
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selects a sample of items from a production lot (or a sample of animals 
from a herd) for a study of the effects of the treatments, he can ensure 
that they are a random sample from the lot, or herd, by introducing 
randomization into the sampling procedure, for example, by drawing 
cards from a hat after thorough mixing, or by using a table of random 
numbers. lie may consider such a sample to be a random sample from 
the production process (or the animal species) only by making the 
assumption that the lot (herd) itself is a random sample from the process 
(species). When a particular experiment is being planned, or the results 
of a completed experiment are being interpreted, the following two 
parallel sets of questions will serve to focus attention on the issue of 
systematic versus random variation: 

(1) Are the conclusions to be confined to the things actually studied 
(the sample of items, or animals), or to the immediate sources of these 
things (the actual machines, or lots, or herds from which the things 
studied were obtained) ; or are they to be expanded to apply to the under- 
lying populations (real or hypothetical population of machines, or the 
production process, or the species)? 

(2) In complete repetitions of the experiment, would the same 
things be studied again (the same items, animals, or treatments); would 
new samples bo drawn from the identical sources (the same machines, the 
same lots, or the same herds); or would new samples be drawn from the 
underlying populations (samples of items from different machines, or 
animals from different herds of the same breed)? 


6.2. A Typical Analysis of Variance 


This section gives a typical analysis-of-variance table for cases in which 
the random deviations involved are normally distributed. The condi- 
tions are specified under which the test of significance customarily 
associated with this table can be regarded as a test of the hypothesis 
that two variances aj and <r| are equal, relative to the alternative that 
K(Tg, where iiC is a known constant and is an unknown 
variance. Under these conditions the results given in Sec. 4.1 can be 
used in the planning and interpretation of experiments leading to analysis 
of variance tests of significance. 

Let Zi; denote the jth observation in the tth group (i = 1, 2, • • • , 
/■; j = 2, • • • , Ui), let denote the average of the Ui observations 
in the ith group (f = 1, 2, • • ■ , k), and let x.. denote the average of 

k 


all N = ^ 


Ui observations; then the analysis-of-variance table takes 




the following form; 
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Variation 

Degrees' 

of 

freedom 

* 

i 

Sum of squares | 

Mean square 

Expecta- 
tion of 

mean 

square 

Between group 


' k 



averages , , . 

1 fc - 1 

1 .si * 2 

1 t-i 

1 fc 

Sl/{k - 1) = 8^ 

<r‘ + 

Within groups. 

N ~k 

s: = 2 ^ - *.■)* 

»-l /=! 

Sl/(N - t) - i * 

O'* 




n = (A* — ^ ni)/\N{k — 1)1; when ni = n» == ~ n, a ~ n. 

tm I 

If the Xxi are independently and normally distributed about the 
respective true means nii of the groups with common (unknown) variance 
ff*, and if the groups are a random selection from a population of groups 
such that in repeated selection the m,- would be normally distributed 
about an over-all population mean of m with variance (rj, the j,/ will be 
normally distributed about m with variance 


likewise 


(k - X)sl 


(29) 

(30) 


will be distributed as for (k — 1) degrees of freedom; and finally 

(31) 


will be distributed independently as for (A^ — k) degrees of freedom. 

A comparison of (30) and (31) with the assumptions made with 
regard to sj and sj in Sec. 4.1 reveals that if we set 

<r? =* <r’ -h nffj; and <r| = <t^ (32) 

Til = (k — I) and = N ~ k (33) 

becomes identified with sf and a® with sj, and the rule of procedure 
becomes 

(a) Accept « 0 (tliere exists no betw'een-group component of 
random variation) whenever 
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(bj Accept > 0 (there exists a betvveen-group component of random 
variation) whenever 

^ > F^(h - I, N - k) ( 35 ) 

Since a] cannot be negative, the probability of an dttot of the firet 
kind (concluding that ffj > 0 when actually <j-| = 0) is exactly or, and 
the probability of an error of the second kind (concluding that = 0 
when actually > 0) is 0 when 

1 + «(? 2 ) = - k) ( 36 ) 

If there are n observations in each group; h = n and 

N — k = k(n — 1); 
so* 

fc — l,fc(n - 1)] - 1 

n ' 

6.3. Illustrations 

The following examples illustrate types of questions to which answers 
may be obtained with the aid of (37): 

Example VII. It is suspected tliat differences between lots 
contribute to the random variation of a particular characteristic of a 
certain product. To investigate this hypothesis, n items are to be 
selected at random and measured, from each of k lots chosen at 
random from the lots currently accessible. It is agreed that the test 
of significance defined by (34) and (35) is to be conducted at the 0.05 
level of significance, and it is desired to have a probability not 
greater than 0.50 of falsely concluding = Oifffp/o-^ = 0.10. What 
combination' of values of k and n will accomplish this wth a minimum 
total number of measurements? 

Baines has prepared the following table for answering such 
questions when a = 0.05 and 0 — 0.50: 


k 

2 

3 

4 

6 

6 

7 

8 

9 


14 

17 

21 

27 

n 

75 

34 

24 

19 

16 

14 

13 

12 

11 

9 

8 

7 

6 

kn 


102 

96 

95 

96 

98 



no 

126 

136 

147 

162 













0 102 


It is seen that the best combination is 19 items from each of 5 lots, 
requiring a total of 95 measurements. However, if it is more con- 


* Baines, Economical Design, tabulates (37) for « = 0.05, p = 0.50, fc = 2 to 31 
by steps of 1, and n = 1 to 31 by steps of 1, 31 to 45 by steps of 2, 45 to 93 by steps of 
4, 101, and 121. 
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venient to use 4 lots than 5 lots, 24 items from each of 4 lots will be 
equally effective and \\all require only one additional measurement. 

'Example VIII. If it were agreed initially in planning a test of 
the type discussed in Example VII that a total of 96 measurements 
would be employed, then the problem would arise of deterjnining 
the combination of values of k and n, subject to the restriction 
kn = 96, that minimizes the value of for a given /3. 

Baines gives the figures tabulated below, which apply when 
a ~ 0.05 and ^ = 0.50: 


h 


3 

1 4 

6 

1 ^ 

12 

1 

1 

n 


32 

1 24 

16 

12 

8 1 

1 0 1 

1 4 



0.107 

1 0.100 

1 0.103 ' 

1 0.110 

1 0.126 ' 

1 0.143 ' 

1 0.178 


It is clear that the combination fc = 4, n = 24 provides the most 
stringent test having a = 0.05 and kn = 96, in the sense that it 
yields the minimum indifference point. 

In order to answer readily questions of the type illustrated by Exam- 
ples VII and VIII when a and differ from 0.05 and 0.50, respectively, 
tables of (37) should be prepared using k and n as arguments. Indeed, to 
facilitate the planning of experiments leading to analysis-of-variance 
tests corresponding to two-way classifications (“rows” and “columns”), to 
Latin square designs, and so forth, sets of such tables will have Lo be 
prepared for each type of design, since the number of degrees of freedom 
corresponding to the estimate of error variance .•?! depend.^ upon the 
design of the experiment [for a two-way classification, for example, 
/i 2 = (r — l)(c — 1)}, as does also the numV^er of degrees of freedom 
corresponding to the estimate of variance sf to be tested. Until such 
tables are available, these questions can be answered, with considerable 
effort expended on interpolation, by means of Tables 8.3 and 8.4. Fur- 
thermore, Tables 8.3 and 8.4 will often suffice to determine a few points 
on the operating-characteristic curve of a test of significance correspond- 
ing to an experimental design already agreed upon. 

6. TECHNICAL NOTES 

6.1. Method of Construction and Accuracy of Tables 8.1 and 8.2 

As explained in Sec. 2, the standard procedure for determining 
whether a new product or process is more variable than a standard 
product or process is to compute the statistic s\/tTl and 
(a) Accept the conclusion <ri/<r§ < 1 whenever 

<r\ ~ ni 


( 38 ) 
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(b) Accept the conclusion > 1 whenever 


s\ xlM 

Vo nx 


(39) 


where xK^i) is the a level of significance of x* for rii degrees of freedom. 
The level of significance or represents the probability of accepting the 
conclusion > 1 when in fact vf/<r| = 1 (error of the first kind). 

Using this level of significance, the probability of accepting the con- 
clusion <t\/cI < 1 when in fact viAo >■ 1 (error of the second kind) 
depends on the ratio p = o\/o\ and is exactly /3 if p has the value 


. . . XaM 

p(a,^,ni) = a 


(40) 


xT-^>(Wl) 

The proof is elementary. Since the conclusion < 1 will be reached 
whenever (38) occurs, the probability of this conclusion, given <rl = ptrl, 
is 


^ Xa(«l) , ,1 r. ^<^0 2/ s' 

•P - < vj = pvj = P — < - Xaini). 

I Vq W-l / Vj 


2 2 
Vi — pffo 


= P\x-(nx) < 


xl(«,) 


= 1 -P X'(«i) > 


xl(nx) 


From (40), 


X^(ni) 


= xl-fiM 


so the last form of (41) becomes 

1 - (1 - 0) = ^ 


(41) 


(42) 

(43) 


which completes the proof.* 

Thompson’s table of x2(?i]) was used in constructing Tables 8.1 
and 8.2. Direct substitution of these values in formula (40) yields 
values of p{a,0,n) corresponding to a = 0.05 and 0.01 and to ^ = 0.005, 
0.01, 0.025, 0.05, 0.10, 0.25, 0.60. 0.750, 0.900, 0.950, 0.975, 0.990, and 
0.995 for n = 1 to 30 by steps of 1 and 30 to 100 by steps of 10. The 
values of p(0.05,^,/i), rounded to 5 figures or 4 decimals, are given in 

• Values of xK^^i) corresponding to a = 0.01, 0 02, 0.05, 0.10, 0.20, 0.30, 0.50, 
0.70, 0-80, 0.90, 0.95, 0.98, and 0.99 are given to 3 decimals for n, = 1 to 30 by steps 
of 1 in Table 111 of Fisher, SUitistical Methods and in Table IV of Fisher and Yates, 
Statistical Tables, the latter of which also contains the values for « = 0.001. Values of 
xl(ni) corresponding to = 0.005, 0.010, 0.025, 0.050, 0.100, 0.250, 0.500, 0.750, 
0.900, 0.950, 0.975, 0.990, and 0.995 are given to 6 significant figures for nt = 1 to 
30 by steps of I and from 30 to 100 by steps of 10 by Thompson, “ x® distribution.” 
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Table 8.1. The corresponding values of p(0.01,^,n) are given in Table 

8.2. The values of p(a,0,n) for n = 120 were computed from values of 
Xa(120) obtained from the percentage points of the F distribution tabled 
by Merrington and Thompson, by means of the relation 

xUn) = nF„(n,ao) (44) 

Two-point interpolation in Tables 8.1 and 8.2 in terms of the argument 
Xf'sfn will yield about 2-decimal accuracy in most parts of these tables.* 

6.2. Method of Construction and Accuracy of Tables 8.3 and 8.4 

The procedure described in Sec. 4. 1 for determining whether a particu- 
lar one of two new products or processes is more variable than the 
other is as follows: Compute the statistic where sf'and s| are 

sample estimates of the two population variances such that in repeated 
sampling riisj/a? and nts|/<r| will be distributed independently as x’ for 
m and n% degrees of freedom, respectively. Base the choice of product 
or process on the rule 

(a) Accept product I whenever 

% < F^(nunt) (45) 

(b) Accept product II whenever 

^ > F.(n.,n,) (46) 

where Fa(ni,n 2 ) is the a level of significance of the variance ratio (F) 
distribution. This rule is so formulated that the probability of accepting 
product II when in fact = 1 (error of the first kind) equals the level 
of significance a. The probability of accepting product I when in fact 
<rf > a-l (error of the second kind) depends on the ratio * c\/o\ and 
is exactly ^ when 

(47) 

= Fo(ni,W2) - Fpfna.ni) 

The proof is similar to the proof of (40). Product 1 will be chosen 
whenever (45) occurs, and the probability of this when al/al — 0 in 

* Interpolation with respect to a and 0 should be carried out in terms of Ka and 
Kq. respectively, where K, is the unit normal deviate exceeded with probability e 
(tabled in Chap. 1, Table 1.1). For an explanation and examples of this type of 
interpolation, see Simaika, Interpolation. 
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/s? 


p < Fa{n],ni) 


when* 


= =p 


<T? ^ F^ini,ni)\a\ 

7? ^ 






</> 


= 1 — P {P(n 1,^2) > 


Faini,n^) 

4> 


= 1 - (1 - ^) = ^ 


Fainiyfii) 

<i> 


~ Fi-ff(ni,n2) 


(48) 


(49) 


Tables 8.3 and 8.4 at the end of this chapter were computed from 
the IMerrington-Thompson table of F by direct substitution in formula 
(47). These tables give the values of <t>(a,0,ni,nz) for a — 0.050 and 
a = 0.010, respectively, corresponding to 0 = 0.005, 0.010, 0.025,0.050, 
0.100, 0.250, 0.500, 0.750, 0.900, 0.950, 0.976, 0.990, 0.995, for ni = ItolQ 
by steps-of 1, and 12, 15, 20, 24, 30, 40, 60, 120, w, and n: = 1 to 10 by 
steps of 1, and 12, 15, 20, 24, 30, 40, 60, 120, = 0 . Interpolation for valuefj 
of 4 >{a, 0 ,ni,n 2 ) corresponding to values of n\ and ns between those given in 
these tables should be done harmonically, that is, in terms of 1/ni and l/n 2 . 
In this connection it should be noted that the sequence « , 120, 60, 40, 30, 
24, 20 corresponds to 120/m for m = 0, 1, 2, 3, 4, 5, and G, respectively; 
and that the sequence », 00, 30, 20, 15, 12, 10 corresponds to 60/r for 
r — 0, I, 2, 3, 4, 5, and 0, respectively. Accordingly, interpolation i.s 
most conveniently carried out in terms of the arguments m and r. Two-- 
point harmonic interpolation will generally give •i> to sufficient accuracy 
for most practical purposes. For example, by 2-point harmonic- 
interpolation 

^(0.05,0.05,30,24) ^ ^(0-05,0-05,30,20) + ^(0.05,0.05,30,30) ^ 3 

(50) 

The actual value is 3. GOO; customary 2-point linear interpolation give.s 

• The most accurate table of Faint, is that of Rlerrington and Thompson, which 
gives the values to 5 significant figures corresponding to a = 0.005, 0.010, 0.025 
0.050, 0,100, 0.250, and 0.500 for ni * 1 to 10 by steps of 1, and 12, 15,20, 24,30,40, 60, 
120, and nj = 1 to 30 by steps of 1, and 40, 60, 120, «. Values of Faini,ni), 
referred to as e’*, corresponding to a — 0.001, 0.01, O.Oo, 0.20, are given (mostly to 
2 decimals) in Table V of Fisher and Yates, fitolisttcol Tobies for tii = 1 to 6 by steps 
of 1, and 8, 12, 24, « , and nj = 1 to 30 by steps of 1, and 40, 60, 120, «» . 
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3.719. Similarly, by 2-point harmonic interpolation 
^(0.05,0.05,30,120) ^ ^ IQjL5. 0-Q 5>30, 60) + _ 0(O.O 5.O, Q5,3O ,c.) ^ 

(51) 

The actual value is 2.617. Use may be made of the fact that 

<^(a,0,n,,^) = p(a,^,ni) (52) 

to obtain values of the left side.of this equality for values of ni included 
in Tables 8.1 and 8.2 but not in Tables 8.3 and 8.4. 
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CHAPTER 9 


UTILIZATION OF LIMITED EXPERIMENTAL FACILITIES 
WHEN THE COST OF EACH MEASUREMENT DEPENDS 
ON ITS MAGNITUDE 

1. TYPE OF PROBLEM 

A primary objective in the statistical design of experiments is to 
maximize the amount of pertinent information obtained from a given 
amount of time, equipment, personnel, and supplies, or, conversely, to 
minimize the cost of obtaining a given amount of information. In many 
experiments the cost of an observation can be regarded as a constant j 
such is the case, for example, in tho problem of Chap. 11. Sometimes 
the cost of an observ’ation is determined by the independent variables, as, 
for example, when an independent variable is the amount of some expen- 
sive substance or type of energy. This chapter is concerned with a third 
situation, in which the cost of an observation depends on the value of 
the dependent variable; a simple case occurs when the dependent variable 
is determined by counting, so that the time and labor involved in a 
measurement are proportional to its magnitude. Insofar as the depend- 
ent and independent variables are correlated, the latter two situations 
are essentially the same. 

An interesting case in which the cost of an obsenration depends on 
its magnitude, one which illustrates the interplay of statistical principles 
and substantive considerations in applied statistics, occurs in metallurgical 
experiments to determine the relation between time to rupture and 
sti’css for a given alloy. In investigating this relation, each observation 
is obtained by subjecting a test specimen to a predetermined constant 
.stress and recording the amount of time that elapses before the specimen 
breaks. The number of observations that can be obtained in a given 
period of time from a single piece of equipment thus depends on how long 
it takes each specimen to rupture, which in turn depends largely on the 
stress to which the test specimen is subjected. 

If the logarithm of time to rupture is a linear function of the logarithm 
of stress (and there is strong evidence that this is approximately so 
for a large number of alloys over the range of important stresses), tests 
at any two stresses suffice to estimate the line relating the two variables, 
and from this line can be predicted the time to rupture at any other 
stress. The error in such a prediction depends on the number of tests 
from which the line is estimated and on the stresses at which they are 
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tnade. But the number of tests made itself depends on the stresses at 
which they are made, since the lower the stress, the longer it takes for a 
specimen to break, and hence the fewer the tests that can be made in a 
limited period with given equipment. This factor, taken by itself, would 
argue for using as higli stresses as possible, in order to have many tests. 
However, the higher the stresses, the farther it is necessary to extrapolate 
the line to predict time to rupture at the stresses which are practically 
important. Further, Avhile the percentage error in test results seems 
reasonably independent of the stress used for a fairly wide range of 
stresses, it will doubtless increase if the stress is raised sufficiently. 
Thus there is a real problem about the best stresses at which to test; 
there are opposing considerations that have to be evaluated quantitatively 
to get a definite answer. 


2. SPECIFIC PROBLEM 

It will facilitate the solution of the problem to state it more formally, 
as follows: 

Given: (1) The relation between time to rupture and stress is 

/ = a + (3s (1) 

where t is the logaritlim of time to rupture, s is the logarithm of tho 
stress, and a and are constants describing the "true” (but unknown) 
relationship. 

(2) The number of specimens that can be tested is limited solely by 
the fact that there arc a limited number of machines available and a 
limited amount of time. 

(3) The percentage error in the determination of time to rupture 
does not depend on stress; that is, if a great many determinations were 
made at each of a number of stresses, tlie percentage variation in the 
determinations would be the same at all stresses. 'J'his assumption will 
undoubtedly break down at sufficiently high stresses, but it seems to 
be confirmed by the available evidence for stresses ordinarily used. 

Tiequired: (1) The stresses at which to make the tests, and (2) the 
best apportionment of the tests among these stresses, in order to estimate 
as accurately as possible (o) the slope & of the line relating t to s, and (b) 
the time to rupture at some predetermined stress, or range of stresses, 
of practical importance, ordinarily considerably below the stresses at 
which the tests are conducted. 

3. SOLUTION 

The solution of this problem is as follows: 

(1) It is always better to use two testing stresses than to use more 
than two. 
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(2) For purpose (6) it might sometimes be best to use only one stress 
*So of practical importance. However, since this would give no informa- 
tion about the time to rupture at any other stress, it would ignore purpose 
(a) and is therefore excluded. 

(3) Let Si and^Si be the two best testing stresses (S 2 > Si). Then 
the best ratio of the two stresses, say, R ~ Si/Sz, is given by solving 
the following equation for R: 

|log. « = (2) 


This is the best ratio both for estimating the slope and for estimating 
the time to rupture at So, provided So is less than Si, the case of primary 
interest.* The best ratio of the two testing stresses is therefore indepen- 
dent of So and <leponds only on 0. The value of is, of course, to be 
determined from the experiment; but some advance estimate is needed 
because the relative times required for tests at two different stresses 
depend on /3. However, the advance estimate need not be very accurate, 
since even fairly large errors in the estimate of ^ will not lead to any 
great loss in efficiency. 

(4) Under the given assumptions, the absolute values of jSi and Sa 
cannot be determined. So long as assumption (3) of Sec. 2 is satisfied, 
namely, tliat the percentage error is independent of stress, the higher 
the testing stresses the better. In practice, therefore, S 2 should be 
chosen as the highest testing stress for which the percentage error can 
reasonably be expected to be no larger than at lower stresses. Si can 
then be determined from the R given by equation (2). 

(5) Let ni be the number of tests to be made at »Si and rii the number 

to be made at S 2 . Let r — The ratio r is all that needs to be 

determined, since the total number of tests, ni -h n*, is determined by 
Si and Ss and by the time and eejuipment available. The best value of r 
depends on the objective. If the objective is to estimate as accurately 
as possible, the best value of r is given by 


r ^ R ^ 


(3) 


If the objective is to estimate the time to rupture at So as accurately 
as possible, the best value of r is given by 


r 


, 5o 
log — 

= R 2 


Si 


N So 

Si 


(4) 


* See Sec. 4,3, especially the last paragraph, for a discussion of the case where 

S, < 5a. 
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The best value of r in this case depends on So- This means that it is 
not possible to design the experiment so as to get the best estimate of 
the time to rupture at each of a range of -So's. It is necessary to com- 
promise among the objectives. 

(6) The following numerical calculation illustrates the solution. 
For one particular series of cast alloys tested at a particular elevated 
temperature, ^ is found to be approximately —8. If 52 is taken as 30,000 
pounds per square inch (p.s.i.), the best value of Si turns out to be 22,000 
p.a.i. The best apportionment of the tests between the two stresses is as 
follows: 


Objoclive is to estimate as 
accurately as possible 

Number of tests to i 
be made at 22,OCO 1 
p.s.i. for each test i 
at 30,000 p.a.i. 1 

j 

Percentage gain in precision 
over using 0.50 tests at 
25,000 p.s.i. for every test 
at 30,000 p.s.i. 

(o) Slope 

(6) Time to rupture at stress of 

0.26 

39 

5,000 p.a.i 

0.35 

42 

10,000 p.s.i 

0.4\ 

45 

16,000 p.s.i 

0.53 

47 

20,000 p.s.i 

1.25 

1 55 


The last column gives the gain in precision, whicii is eiiuivalent to the 
savings in testing for a given degree of precision, over an alternative 
combination of stresses and relative number of observations, which 
differs only moderately from the optimum combination; it indicates the 
value of careful planning of the stresses at which to test and of the relative 
number of tests at different stresses. 

4. MATHEMATICAL DEVELOPMENT 

4.1. Notation 

Let T = time to rupture 

t = logarithm of time to rupture 
5 = stress 

50 = stress lor which it is desired to estimate time to rupture 

51 == smaller of two testing stresses to be used 

52 = larger of two testing stresses to be used 
Til = number of tests to be made at 5i 
nz = number of tests to be made at 52 

n — Hi nz 
R = Si/Sz 
r = Ui/riz 

a, ^ = parameters of line relating log T to log 5, so that 
log T = a -h j5 log 5 


( 5 ) 
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a,b = estimates of a and ^ 

to = estimate of logarithm of time to rupture at stress So 
K = total amount of machine time available 
<r = standard deviation of observations about the line (5), 
assumed the same for all S 
(Tf, = standard deviation of estimated slope 

Cl =■ standard deviation of logarithm of estimated time to rupture 
For convenience, take ail logarithms to be natural logarithms. 

We assume that the parameters of the line are estimated from the data 
by the usual least-squares procedure applied to the logarithms of the 
variables. Then, by algebraic manipulation of the usual formulas,* 


\ 


= 


Hi -\~n-t 




»,(log|) +»»(lo8|) 


(fi) 


( 7 ) 


The problem is to minimize (0) and (7) by proper choice of ni, ns, Sj, 
and S 2 , subject to the constraint that a fixed amount of machine time is 
used. Since T — e^S^, this constraint is 


nie“Sf ■+• ntc*S? * K (8) 

or 

n-iSi + nsSf = Ke~^ = k ^ (9) 

It will clarify the solution and yield useful supplementary results Co 
proceed to the final solution in stages, rather than at one stop. We shall, 
therefore, first assume Si and S 2 given and determine the optimum value 
of r; thereafter wc shall proceed to determine the optimum, value of R. 


4.2. Objective to Get Best Estimate of Slope 


The problem is to maximize 

<r^ ~ + «2 



( 10 ) 


subject to (9), since this will minimize the variance of the slope as given 
by (6). 

Replacing Ui by rnz in (9) and (10), solving (9) so modified for nj, and 
substituting the result for n 2 in (10) gives 


kr 




<^1 


(1 + r)(rS? + St) 


( 11 ) 


* See Fisher, Slatisiical MeihotU, Sec. 26, pp. 133, 135. (For full citation, see 
Sec. 5.) 
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to be maximized with respect to r, without restraint and with Si and Ss 
assumed fixed. Setting the derivative with respect to r equal to zero 
gives 


A solution to (12) is obtained by setting 


dr 


~ k 


(-!)■ 




(1 + r)=(r,S? + Sip 


= 0 


( 12 ) 


5f _ r^-Sf = 0 (13) 



where we take the positive square root, as r is essentially positive. A 
check on the second derivative shows that this solution does maximize 
(11). Substituting (14) into (11) and faking the reciprocal gives 




(15) 


•IS the minimum ratio of the variance of the estimated slope to the 
variance of an individual obseiwation, given Si and S 2 . 

Replacing Si by RSz in (15) gives 


4 ^ (i?^ + iy-sj 

cr= ili(log RY 


(16) 


Consider S 2 as fixed and minimize (10) with respect to R; this gives 



dR 


whence 


(R^ + 1 ) 

A:S(log RP 


log n - 


8 

I iog.fi: - 1 ^r -2 



(17) 

08 ) 


A check on the second derivative shows that this solution does minimize 

( 16 ). 

Substituting the value for log R from (18) in (16) gives 

0-2 -Ik 


09 ) 
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as the minimum value of (16), given S^. Since j3 is negative, it is clear 
that the larger the smaller the variance; hence there is no finite 
optimum value of Ss. Tn practice, increases in S 2 beyond some point will 
increase o--, and the optimum value of S 2 will be somewhere near this 
point.* 


4.3. Objective to Get Best Estimate of Time to Rupture at a Given. Stress 


The problem here is to minimize (7) subject to (9). Replacing tii by 
rnj in (7) and (9), solving (9) so modified for n^, and substituting the 
result in (7) gives 


.-(logiy+C'ogiyjirgf+gg] 

iT(iog|y 


( 20 ) 


to be minimized with respect to r, without restraint and with Si and S 2 
assumed fixed. Setting the dcrivati\-e of (20) witli respert to r equal to 
zero gives 




[r--.Sf(jog|y-.9f(l„g|)-] 


0 ( 21 ) 


From (21) the minimizing solution is given by 


r 


2 = 


or 


r 



The positive sign is required to make r positive if So is less than »Si or 
greater than the negative sign, if >Si < So < S 5 . The second deriva- 
tive shows that these signs also give minima. Since we are concerned 
primarily with values of So that are below Si, we shall hereafter consider 
only the positive sign. 

* It will pay to go somewhat beyond the point at which starts to increase, since 
the loss from the increase in <r* will for s time be less than the gain from the increase 
in S2. 
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Substituting (23) into (20) gives as the imnimum ratio of the variance 
of the estimated rupture time to the variance of an individual observa- 
tion, with *Sii and S-i fixed. 








(24) 


On replacing by RS^, (24) becomes 
(I + ah log ^ 


<^ 1 . 


S? 


log R 


- I 


(25) 


from which, holding ^2 fixed, 



W) _ 2Sf 

[‘(l + R5)log| 


dR k 

log R 

[ ;?(]og^)= J 


= 0 (26) 

For So less than 5i, there is no value of R that will make the first bracket 
equal to zero. A-CCordingly, the minimizing value of J? is given by 

^R^\ogR - I - = 0 (27) 

or 

I log K = 1 + K‘5 ( 28 ) 


which is the same as (18), the solution for minimizing the variance of 
the slope. This is, of course, the minimizing value only if S 2 is sufficiently 
large so that the derived Si is larger than *So. 

By differentiating (25) with respect to S 2 , it can be shown that (25) 
decreases as >82 increases, so that there is no finite optimum value of ^ 2 . 

If ^2 is chosen greater than So, while Si derived from the R satisfying 
(28) is less than So, (28) no longer gives the optimum solution. In that 
case, it turns out that the variance is a monotonically decreasing function 
of R. The best that can be done is to take the largest possible value of 
R, namely, R = S 0 /S 2 , or Si = So. This solution using two testing 
stresses will not, however, be as good as that putting all the tests at So. 
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CHAPTER 10 


EXPERIMENTS IN WHICH THE INDEPENDENT VARIABLE 
IS KNOWN ONLY IN TERMS OF A 
PROBABILITY DISTRIBUTION 

1. PROBLEM 

1.1. Type of Problem 

This chapter deals with a type of problem in which it is desired to 
subject each of a number of items to a test of at least a given severity, 
but the severity of any one test cannot be measured and cannot be con- 
trolled precisely. Thus it is necessary to make an independent study of 
the probability that a test will attain the specified severity and then to 
determine the number of tests necessary for each item in order to attain 
a given probability that at least one test will be of the specified severity. 
The particular problem discussed is relatively simple, and tlie chapter is 
intended more to suggest an interesting and in some respects important 
type of problem and to indicate an approach to it, than to present a 
solution or a novel application of statistical techniques. 

1.2. Specific Problem 

A gun barrel is considered fit for service with respect to its pressure- 
resisting properties if it has fired a round such that the gas pressure 
developed is not less than a prescribed pressure K, K being greater than 
any pressure that may reasonably occur m service. Special ammunition 
that develops high pressures is used for proofing the barrels.* In order to 
measure the pressure developed by a round, a hole must be bored in the 
barrel, which renders it unfit for service. Consequently, it is impossible 
to ascertain with certainty that a barrel intended for service has actually 
been proofed. It is, however, possible to draw conclusions about the 
percentage of barrels proofed from a study of the characteristics of the 
special ammunition. When a lot of the latter is delivered, a small fixed 
sample of size n is tested for pressure and the remainder (which is almost 
the whole lot) is used for proofing, N rounds being fired in each barrel 
to be proofed. Manufacture of the special ammunition is in a sufficiently 
satisfactory state that the proportion of defective rounds, that is, those 
which generate a pressure less than K, is usually very small (of the order 
of 0.001). The problem is, on the basis of the results from the sample of 
n, (1) to set up criteria for accepting or rejecting the lot, and (2) to 
determine N, the number of rounds to be fired in each barrel. 
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1 2 -3 ♦ -5 -6 T. a 9 10 

Observed proportion iar/n) 


Fhj. lO.l.— Niiiety-uiiie pertwit coufidenc© belts £or populatiou proportiou. 

2. SOLUTION 

Choose y, a confidence coefficient with which to operate, the minimum 
number of barrels that an acceptable lot should proof, and the minimum 
tolerable probability of proofing a barrel. From the sample of n obtain 
an estimate p-f with confidence coefficient y of an upper bound on the 
proportion of rounds in the lot which, when fired, iWll generate a pres- 
sure less than K. How this estimate is to be obtained is described in 
Sec. 3. Construct a table as follows: 


Number ol rounds (N) 
fired in each barrel 
1 
2 


With cuuGdence cuefficient y, 
the probability that a barrel 
will be proofed is at least 

1 -h 
i-n 


1 


From the table select the smallest N yielding the required probability of 
proofing a barrel. If this JV is too large to enable the lot of ammunition 
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Observed proportion ( x/n ) 

Fw. 1 0.2.— Ninety-five percent confi<lence bolts for population proportion. 

to proof the minimum required number of baiTels, reject the lot. Other- 
wise, fire N rounds in each barrel. 

3. CONFIDENCE LIMITS FOR PROPORTION DEFECTIVE 


3.1. Attributes 


If the upper confidence limit py is determined by attributes, that is, by 
classifying each round in the sample of n as above K or below K, it is 
unnecessary to make any assumption, whatever about the distribution 
of the pressures of the bullets of the lot. It is only necessary that the 
sample of n be selected at random. If it is believed that defective 
rounds do not occur independently (for example, if a machine functions 
improperly, all the bullets it produces may be defective and these may be 
adjacent in the lot), the N bullets to be fired from any gun barrel should 
be chosen at random from the lot. 

Perhaps the most accurate convenient method of finding Py is with 
the aid of Thompson’s table of percentage points of the incomplete 
beta function. Let 
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Population propor lion (P) 



Fig. 10,3. — Ninety percent cunridence belts for population proportion. 

c = number of rounds in the sample of n 

whose pressures are less than K (1) 

a = 100(1 - y) (2) 

= 2(c + 1) (3) 

V 2 = 2(n — c) (4) 

Enter the table with vt and vz on the <x pcrccntagc-point page and find x. 
Then Py = 1 — x. For example, if 7 = 0.975, c = 0 . n = 30, we have 

a = 2.5, v\ = 2, Vi = 00; from the table we find x = 0.88430, or po.gvs 

= 0.1157. The table of Sec. 2 then appears as follows: 

Miiiimum 
iV probability 

1 0.8843 

0 9866 
0.9986 


3 


etc. 
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Popuioiion proportion(P) 



Fio. 10.4. — Eighty i>ercent confidence belts for population proportion. 

Note: When c = 0, 1 ~ (1 “■ t)**- 

When 7 ^ 0.995, 0.975, 0.95, or 0.90, py may be found from Figs. 
10.1, 10.2, 10.3, or 10.4.* These show belts within which we may assert, 

•Figures 10.1 and 10.2 are reproduced from Pearson and Clopper, “Confidence 
Limits,’’ by permission of Biometrika. Figures 10.3 and 10.4 arc based on computa- 
tions from Thompson’s “Incomplete Beta Function” made (in cooperation with the 
Statistical Research Group) by K. L, Deckingcr of the Bureau of Ordnance, U.S. Navj’, 
and furnished through the courtesy of 11. It. Park. (For full citations, see Sec. 5.) 

With regard to Figs. 10.1 and 10.2, Professor E. S. Pearson writes in part: 
“Actually I believe they are not completely accurate, as the levels at certain points 
were obtained by interpolation and not by direct calculation from the ‘Incomplete 
Beta Function.’ If we reproduce such diagrams ourselves, we shall have to look into 
this point.” (T etter of January 16, 1946, to one of the editors ) 

For Figs. 10.3 and 10.4, abscissas WCTe computed for ordinates between 0 and 1 by 
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with confidence coefficient of, say, P, that the true proportion lies when 
the observed proportion is x/n. For the present purposes y is related 
to r by 

r = 27 - 1 (6) 

Thus, for the example of the preceding paragraph (where y = 0.975), 
r = 0.95. From Fig. JO. 2 we see that the upper curve for n = 30 cuts 
the axis i/n = 0 at about 0.11 or 0 . 12 . 

Still another method of finding is by means of the arcsin trans- 
formation described in Chap. 16. Thus 

f), =sm= (arcsin + ( 6 ) 

where is the normal deviate excee<led with probability 1 — 7 (see 


Table 1.1 of Chap. 1). This for'mula is not satisfactory, however, when 
c/n is very small, especially not when c = 0 . 

It should be noted that tlie foregoing assumes the lot to be large 
enough relative to the sample so that the effect of lot size can be ignored; 
this -will almost always be the cose in practice. 

3.2. Variables 

If it can be assumed that the gas pressures of the bullets in the lot are 
random independent observations on a normally distributed variate, can 
be determined by the method described in Cb.ap. 1 , Sec. 8.2 (pp. 42-45).* 
The value of V given by e<iuation (5) of this chapter is used as the value 
of 7 in Chap. 1; in other words, Lp of Chap. 1 corresponds with 1 — 7 of 
this chapter. 

4. SIZE OF PRELIMINARY SAMPLE 

While the rounds expended in testing the initial Sample of n do not 
serve directly to proof Tnachine-gun barrels, it would bo an error to 

steps of 0.1, using Thompson’s “Incomplete Beta Function.” For a confidence 
coefficient T (in Fig. 10.3, r =* 0.90; in Fig. 10.4, F = 0.80), the upper (lower) abscissa 
for a given value of n represents the value of x/n that will be exceeded (fallen short of) 
with probability (1 — r)/2 in samples of size n from a binomial population with 
parameter P. A smooth curve was passed through the 11 points, but is shown on 
the chart only over the range 1/n' < x/n < I — 1/n', where n' is the next sample 
size above n shown on the chart. Outside this range the curve was bent so that at 
abscissas 0 and 1 the ordinates are 1 — (1 — and (1 — respectively, 

instead of i — [(1 — r)/2J^* anti [(1 — r)/21'^*. The reason for the difference in 
computation at x/n « 0 and 1 is that there the confidence interval must lie entirely 
,to one side of tho observed proportion. In deciding where to bend the curve, it was 
assumed that a given curve will never be used in the intervals 0 < x/n < 1/n' and 
1 - 1/n' < X < 1, and that only for interpolation will it ever i)e used in the intervals 
1/n' < x/n < 1/n and 1 — 1/n < x/n < 1 — 1/n'. 

*A slightly more accurate method is given in Chap. I, Sec. 11.4.G, Problem II, 
where e corresponds with 1 — t of this chapter (see pp. 70-77). 
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characterize them as wastod and to try to Jceep n as small as possible. 
Actually these rounds supply information about the quality of the ammu- 
nition, and more information can easily result in an actual saving of 
ammunition. Suppose, for example, that a lot contains 10,000 rounds, of 
which (unknown to us) 10 (0.1 percent) are defective, that we wish to 
operate with a 0.99 confidence coefficient, and that the minimum tolerable 
probability of proofing a barrel is to be 0.99. Suppose further that in a 
sample of size 20 (a = 20) no defectives appear (c = 0). Proceeding as 
in Sec. 3.1, we construct the following table: 


n = 20 -v = 0.99 c =« 0 

a 0.01 r, -= 2 - 40 

X « 0.79433 po.», - 0.20567 

Minimum 
A' probability 

1 0.79 

2 0 96 

3 0.99 + 

Three rounds are needed for each barrel, so the total number of barrels 
proofed by the lot will be 


10.000 - 20 

3 


3,320 


( 7 ) 


Now, suppose that a sample of GO (n = 00) had been taken and no 
defectives found. Then 

• n - GO y - 0.99 C = 0 

a =• O.Ol n - 2 y, = 120 

* - 0.92012 Po.tt = 0.07388 
Minimum 
N probability 

1 0.93 

2 0.99 + 


Two rounds suffice for each barrel, and the total number of barrels proofed 
by the lot would be 


10.000 - GO 
2 


= 4,970 


( 8 ) 


a 49 percent increase over the previous result. 

Of course the number of defectives in the sample of n is a chance 
variable whose distribution depends on n, among other parameters. On 
the ba.sis of previous experience with the ammunition being used, it Is 
possible to determine that value of n which ia optimum in the sense that 
if the quality of the ammunition is essentially unchanged with time, the 
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CHAPTER 11 


PLANNING AN EXPERIMENT FOR ESTIMATING THE MEAN 
AND STANDARD DEVIATION OF A NORMAL DISTRIBUTION 
FROM OBSERVATIONS ON THE CUMULATIVE DISTRIBUTION 

1. THE PROBLEM 

A clasa of statistical problems of frequent occuirence arises from situa- 
tions in which a characteristic is conceived to be normally distributed 
among the individuals of a population, but measurement of any one 
individual can show only whether the characteristic is above or below a 
certain level. The most familiar form of this problem concerns the 
lethality of varying doses of drugs. The electric impulse necessary to 
ignite a charge of powder in a certain system represents another such 
problem; for, although in this case it is possible to apply increasing 
impulses until ignition occurs, there is some evidence that an impulse 
that fails to cause ignition may alter the sensitivity of the system. In 
such situations a single stimulus of known intensity is applied to each 
individual. The resulting data show the proportions of the individuals 
tested at various intensities whose sensitivity fell below those intensities; 
in other w'ords, the data for each level of stimulus intensity provide one 
observation on the cumulated distribution of sensitivities. Those obser- 
vations may be analyzed to estimate the mean and standard deviation 
of the sensitivity of the individuals comprising the population. 

The present chapter is concerned with certain aspects of the planning 
of experiments that yield ob.servations on the cumulated distribution 
and are analyzed to determine the mean and standard deviation of the 
distribution. For concreteness, the discussion is given in terms of the 
specific problem of planning an experiment to study the sensitivity of a 
radio proximity fuze, A radio proximity fuze, as its name suggests, 
makes use of radio waves to explode a projectile when and if it comes into 
proximity with a target; unlike time fuzes or point-detonating fuzes, it 
requires neither that a definite time of flight be set in advance nor that 
the target be hit directly. If proximity fuzes of a given model behaved 
identically there would, for fixed conditions, be a definite distance from 
the target within which all fuzes would operate and beyond which none 
would operate. Actually, there are random variations in the fuzes and 
in the impulses returned by the target; so if a number of fuzes pass exactly 
the same distance from a target under the same conditions, some operate 
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and some do noL An important parameter of fuze performanee is, 
therefore, the probability that a fuze mil operate if it passes within a 
certain distance of the target. 


2. METHOD OF ANALYSIS 

It has been determined from a certain set of 1,211 test firings made 
under relatively homogeneous conditions that the probability that a 
nondefective fuze will operate if it passes within a certain distance of the 
target can be well represented by assuming (o) that each nondefective 
fuze is characterized by a definite sensitivity, or maximum distance at 
which it will function, and (b) that these sensitivities are normally 
distributed among fuzes. 

Let S be the sensitivity of a fuze, defined as the maximum distance at 
which that fuze fired under the given circumstances will 
function 

a be the true (population) arithmetic mean sensitivity 
(7 be the true (population) standard deviation of sensitivity 
Then under the above assumptions the probability that a fuze will have 
a sensitivity between S and S -b <i5 is 



(3-0)* 

e 2^* dS 


(0 


% 

The proportion T{d) of fuzes passing a given distance d from the target 
that operate is then the integral of (1) from d to », since every fuze 
whose sensitivity is greater than d will operate at d, while every fuze 
whose sensitivity is less will not. Therefore, 

nd) ^ / r“ dS (2) 

<r \/2TrJd 


In firing trials, it is not pos.sible to obser\’c the sensitivity of n fuze. 
Each fuze can be fired only once; all that cun be observed is the minimum 
distance from the target and whether the fuze operated in proximity to 
the target.* The observations obtained arc therefore observations on 
T{d), the integral of the normal curve, and not directly on S. 

Methods for analyzing such data have been develope<l, primarily in 
connection with dosage-mortality curves.^ These methods involve writ- 
✓ 

* Actually, the entire trajectory' of the fuze can l>c obaci'vcd and also the actual 
point where the fuze operated. However, aa these play no role in the problem con- 
sidered here, they arc ignored. 

t Sec Bliss, “The Calculation of the Dosage-mortality (Airvc,” “'I'lie Comparison 
• of Dosage-mortality Data,” “Kstimaliiig the Doaagc-tnortality (hirve,” and “The 
Calculation of the Time Mortality Cun'c”; also Fisher and Yates, Tables, pj? 8-12. 
^ (For full citations, see Sec. 6.) 
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ing (2) as 


where 


An observed value of T(d) can be converted into an estimate of Y by 
means of tables of the normal probability integral.* The estimate of Y 
may be denoted by y. Now, 1' is linearly related to d by 

y=_e + l<i. (5) 

C <J 

Hence the observed data may be analyzed by fitting a straight line to 
the observed values {y,d). The usual direct methods of fitting a straight 
line cannot bo used, however, since the variance of y is not a constant but 
depends on Y ; instead, a method of successive approximations is used. 
Tables are available to facilitate fitting the straight line by this method. t 
To avoid negative values, some of these tables use “probits/’ defined as 
normal deviates increased by 5, instead of the normal deviates themselves. 

The function (5) was fitted to the data, observed in the 1,211 test 
firings on fuze performance mentioned previously. The estimates of y 
and <r turned out to be A and B, respectively. J Figure 11.1 shows the 
fitted function (5), as well as 90 percent confidence limits on it. These 
confidence limits were computed from the equation | 




y = 


d - 


(3) 

(4) 







+ (d, f 

^ — d)- 

»^i 


( 6 ) 


where N = number of observed points to which the straight line was 
fitted 

Wi = weight given to the fth point in getting the last approximation 
d — weighted average of observed values of d, that is, 

AT V 

2 1 

•-1 *=i 


“ For example, Table 1.5 in Chap. 1 of this volume. 

t For example, Fisher and Yates, Tables, p. 49. Another useful set of tables is 
rontained in Brown, TabUs lo Facililale the Arialysis of Sensitivity Data. This shows 
the ordinate Z of a normal curve, the probability P that a given normal deviate will 
be exceeded, Q = I — P, ZjPQ, and Z*fPQ, all to 5 decimal places for values of Y 
from 0 lo 3 by steps of O.Ol. 

t The numerical values of A and B, which cannot be published, are immaterial 
for the present purposes. 

§ See Bliss, “The Calculation of the Doaage-mortality Curve.” 
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= estimated variance of an observation about the last approxi- 
mation, that is, if Yi is the regression value for the I'th point 
computed from the last approximation, then 

2 »<(»( - YtY 


The problem then arose of collecting similar data under different 
conditions. Theoretical considerations gave little indication of the way 
in which the performance of the fuze would be affected by the difference 

Normal dov'ialo 



Fiu. 11.1. — FitLwd fuiictiun willi 90 percent confidence limits based on 1211 observations. 


in conditions. The scale of the experiment had to be limited to at most 
250 rounds. The statistical problem, with which the rest of this chapter 
deals, is that of distributing these rounds among various possible distances 
from the target in such a way as to get os accurate an estimate as possible 
of T(d). This problem serves to illustrate a number of considerations 
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pertinent to such experiments; while no general, theoretical solution is 
offered, the mode of approach should be at least suggestive in similar 
situations. 

3. STATISTICAL CONSIDERATIONS AFFECTING THE PLANNING 
OF THE EXPERIMENT 

A paradox frequently arises in planning experiments. The most effi- 
cient design depends on the true value of the parameter under investiga- 
tion, but if this were known there would be no need for the experiment. 
This paradox is usually evaded by basing the experimental design on some 
advance estimate of the parameters and trying to adjust the design so 
that the efficiency of the experiment is not much affected by minor 
differences between w'hat is true and what is assumed. This method 
itself raises difficulties, for example, how much of the efficiency that the 
optimum design would have if the advance estimate were correct should 
he sacrificed to gain efficiency if the advance estimate is not correct? 

This difficulty is present in marked degree in the problem under 
consideration and is aggravated by another difficulty, namely, that two , 
parameters are to bo estimated and the experimental design that is best 
for estimating one is not best for estimating the other. The two param- 
eters to be estimated are ^ and or, what is equivalent, the slope and 
intercept of (5). The experiment would be inobt efficient if it could 
minimize both the variance of the estimate of m and that of the estimate 
of <r; unfortunately, the distribution of observations that minimizes the 
variance of the estimate of m is decide<lly different from that which 
minimizes the variance of the estimate of v. 

If a were known, the variance of the estimate of n would be minimized 
by taking all observations at a single distance equal to n. But since a- is 
not known, it would be self-defeating to take all observations at a single 
distance, because (a) this would make it impossible to correct the advance 
estimate of and (6) it would give no inforfnation at all about a. If the 
observed value of T{d) were 50 percent, the estimate of m from the experi- 
ment would be equal to the value of d at which the firings were made, 
that is, it would be the sairfe as the advance estimate. If the observed 
value of T{d) were other than 50 percent, the experiment would indicate 
that the advance estimate of n was wrong but no new estimate could be 
made. Only one point on the straight line (5) would be available, so its 
slope could not be estimated ; hence, it would be impossible to estimate the 
value of tZ at which T((i) = 50 percent. These statements are equivalent, 
of course, to saying that no estimate of <r would be possible either. The 
most that could be learned from an experiment with all observations at an 
estimated ;i would be whether this estimate was correct. 

The variance of the estimate of <r would be minimized by taking all 
observations at two values of d, approximately 1.0 times the estimated 
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value of ff on either side of the estimated value of n. Even though this 
would not give as accurate an estimate of ju as could be obtained by 
placing the observations closer to n, it is a workable arrangement in that 
it would yield estimates of both ft and <r even though the advance esti- 
mates were in error. 

From these considerations alone, the appropriate compromise would 
appear to be to place the observations in two groups located symmetri- 
cally about the e,stimated fi but cloj^er to it than the dist.ance that would 
minimize the variance of the estimate of <r. To decide how much closer 
would require deciding how much it is worth sacrificing accuracy in a to 
gain accuracy in n. 

Other considerations must, however, be taken into account. Placing 
all the observations at two points puts great reliance on the validity of 
equation (2) as a description of T(d). This relation was derived from a 
single body of data, for which its validity cannot bo considered conclu- 
sively established; it may, therefore, not be valid for the new experiment. 
Observations at only two values of d cannot, however, show whether it is 
valid or not, since there will be only two points to which to fit (6), and a 
straight line can always be fitted perfectly to two points. In order to 
determine whether (2), and hence (5), describe the data reasonably well, 
it is necessary to spread the observations among more values of d. The 
desirabilitj' of spreading the observations was reinforced in the present 
experiment by the fact that the data were to be used for other purposes, 
in particular, to study the location of points of functioning, for which a 
wide spread seemed d^lrable. 

Other considerations to be taken into account in the particular experi- 
ment were (1) it was not feasible to use distances greater than about 
A + %B', (2) most of the firings in the earlier experiment had been at 
short distances, so that it seemed desirable to have some firings in the new 
experiment at short distances in order to make a direct comparison of the 
results of the two experiments, independent of any assumptions about the 
form of T(d). 

4. POSSIBLE DESIGNS 

In the light, of the preceding considerations, five alternative ilistribu- 
tions of 250 observations were considered. These are shown in Tabic 
11 . 1 . 

Plans 1 and 2 are suggested by considering how to minimize the 
variance of the estimate of v. The advance estimates, based on the 
previous experiment, were A for ft and D for c. The 250 observations in 
Plans 1 and 2 are divided into two groups and placed symmetrically on 
either side of the mean. In Plan 2, they are about tas far apart as is 
required to minimize the estimate of a; in Plan 1, they are brought closer 
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together to get a more accurate estimate of fi. Plan 3 spieads the obser- 
vation evenly over the five classes spanned by Plan 2; it is symmetrical, 
and its largest distance is the largest that is feasible. Plans 4 and 5 are 
attempts to get some data for the short distances for comparison with the 
previous experiment. In Plan 4, the observations for the low distances 
are obtained by omitting those at since if A is the true mean, such 
firings give no information about o. In Plan 5, the observations for the 
low distances are taken equally from the five groups in Plan 3. 

To measure the relative efficiency of these five possible designs, 90 per- 
cent confidence limits on (5) were computed for each, assuming that the 
correct straight line was that obtained in the earlier experiment, 

y--i+y (s) 

The confidence limits for Plans 1 and 2 are plotted in Fig. 11.2, together 
with the confidence limits obtained from the earlier experiment (sho\^*n 
also in Fig. U.l).* Table 11.2 shows these confidence limits and the 
assumed correct values in somewhat different form, namely, in terms of 
100 T{d), the percentage of nondefective fuzes. 


TABLE ll.I 

Altern'atfve Distributions of 250 Observatioxs 


Distance 

Number of rounds to be fired under plan 

1 ^ 

2 

3 

1 ^ 

5 

A - ^%B 




— 


A - 





30 

A - 


125 

50 


40 

A 

1 125 


50 


40 

A 



50 


' 40 

A+HB 

125 


50 


40 

A -t- ^%B 


1 125 

50 i 

60 

1 40 


Two points are fairly clear from Fig. 11.2 and Table 11.2 (1) Any ^ 

of the five plans for 250 observations gives as much information as, if not 
somewhat more than, the 1,211 observations used in the earlier experi- 
ment; (2) the five possible plans do not differ substantially in efficiency. 
Plan 1, which emphasizes most strongly the accuracy of the estimate of 
gives therefore the narrowest confidence limits for distances near the 
mean. Plan 2, which emphasizes most the accuracy of the estimate of <r, 
gives the narrowest limits for distances far from the mean but the widest 

•The confidence limits for Plans 3, 4, and 5 are omitted from Fig, 11.2 only 
because they are so close to those for Plana 1 and 2 that if all five were plotted on a 
figure the size of Fig. 1 1 .2, it would be impossible to distinguish the five lines. 
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limits for distances near the mean. The other plans are in general 
intermediate. 

On the basis of this evidence, it was decided to recommend Plan 5. 
This plan covers the largest number of values of d and therefore comes 
closest to satisfying objectives other than the minimization of the 
variance ol estimates of n and a\ at the same time, it does not sacrifice 
much efficiency in the estimation of n and of 

Normol devioi« 



Fig. 11.2. — Ninety percent oonlidence limits on assumed function for Wo oJtperU 
mental designs utilizing 250 observations, and for preliminary experiment based on 1211 
observations. 


6. TECHNICAL NOTES* 

The problem of determining the optimum distribution of obsen’afions 
for estimating m and a is considerably simplified by the following two 
requirements, which seem plausible and will be accepted here without 
rigorous proof : 

• I'his section presumes a knowledge of Ibe methods of analysing probit data (see 
Referencea, Sec, 6). 
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(1) The symmetry of the normal distribution implies that the opti- 
mum distribution of observations uill be symmetrical about the true 
mean n. Note that replacing d — fihy its negative will have no effect 
on variances, since these involve only (a) the weights, which depend only 
on the absolute value of (d — M)/<r> and (6) the squares of quantities like 

d - II. 

(2) Since the problem is one of fitting a. straight line containing two^ 

parameters, the optimum distribution will involve placing all the obser- 
vations at two values of d. These two values of d enter into the variances 
in the form of linear combinations of weighted squared deviations. If 
one pair of values, di and dz, such thatdj — — //), contributes 

more to the minimization of the variance than another pair of values, say 
di and di, such that ds — ju = —(dt — n), it will continue to do so no 
matter how many observations are shifted from ds and di to di and d.. 

These two assumptions reduce the problem to one of determining a 
pair of values di and d? such that di — = — (d 2 — fi), at each of which 

half the observations are to be placed. 

Let (i =* population mean ‘ 

<r — population standard deviation 
m = estimate of m . 

s — estimate of <s 

Y, = (,• = 2) 

^ ^ = estimate of 1% 
s 


Ti => ■ / « r dx = true proportion above di 

v2ir Jn 

ti =* estimate of Ti 

Observed values of ii giv-e, from tables of probits or of the normal dis- 
tribution, estimates of yi, and hence two equations 


Pi = 


di — m 


Vi = 


d* — m 


Solving for m and s gives 


m 


8 ~ 


It is known* that 


yidt — ytdi 

yi - yt 
di — da 
yt - Vi 




where 


(9) 

( 10 ) 

( 11 ) 

( 12 ) 

( 13 ) 


See Bliss, “The Calculation of the liosage-morlality Curve.” 
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rii = number of observations at di 


1 

2i = — U € 2 


To a first approximation, 


aL = \ 


( dm 

% 


- ) + I ^ 

\vl/Vy-r,- 
2 ( Y 2 j_ ( dsV j 

<^2 = I -^ ) + I a— J <^v. 

t r. 


(14) 

(15) 


The partial derivatives in (14) and (15) may be evaluated as follown; 
dm ytidi - di) 


dyt {yi - 

dm. _ —yMx - dt) 
dyt (Vi - Vi)- 
ds _ —(di — dj) 
dyi (yi - yt)’ 

ds _ di — dj 
Wt ~ (yi - yt)^ 


Hence 


, _ V|(d, - di)^ r,(i - r.) . YKdi - dt)'^ TiH - Ti) 

(^1 - Yi)* n,zl (Ti - Yi)* 


nas§ 


_ (di - d»)» r.(i - r,) . (dx - di)^ y’ 2 (i - rp 


^ " (Vi - n,2f (Yi - Yi)* 


HiZl 


(16) 

(17) 

(IS) 

(19) 

( 20 ) 
( 21 ) 


Substituting for Yi and Yi in (20) and (21) and simplifying gives 


L, ^,7'.(l - TO , ,,Ti{l - Ti)~\ 

= n .4 ' + ^ ,^1 j 


r> = — 

‘ (di-rfOU 


(1 - TO T*(l - TO 


nizf 


nsz\ 




(22) 

(23) 


So far, no use has been made of the symmetry requirement. Equa- 
tions (22) and (23) are therefore valid for any pair of values of di and dg. 
Symmetry implies that 

n, = n* (24) 

(di - m) = ~(di- m) (25) 

Ti = 1 - Tj (2Q) 

zi = 2* (27) 


Krom (25), 


di ~ di — 2(di — fi) 


(28) 


Substituting into (22) and (23) gives 

\ 
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2 _ T,(l - Ti) 

2 

, <r^ T,{1 - Ti) a2 - Ti) 

2(di ~ fiy ntef 211 ni^f 


(29) 

(30) 


(T^ will be a minimum if 7’i(l — T\)/z\ is a minimum with respect to 
di or, what is the same thing, with respect to Y i. But ri(l — T^/z\ is a 
minimum at 11 = 0, as can be demonstrated by differentiating or, more 
simply, by a glance at the tabled values of — Ti).! Hence, to 

minimize the variance of m, with a assumed known, it would be necessary 
to put all the observations at p. * 

<r2 will be a minimum if Ti(l — T^/z\Y\ is a minimum. DifTerontiat- 
ing yields an equation tliat would have to be solved numerically. Since, 
as noted above, zy[Ti{\ — T|)] is tabled, it is simpler to compute directly 
Y\zl/[Ti(l — ri)! and determine numerically the value of Hat which it 
reaches a maximum. This gives approximately 1.574 or 1.575 as the 
value of Y for which tr] is a minimum.! Hence, the variance of s will be 
minimized by putting half the observations at dv = + 1.57<r, and half 

at d* = p — i.57<T. 
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t The computed values of Y\z\/{Ti{\ — Ti)] for a few values in the neighborhood 
of the iiiaximuiii are, when diminished by O.G08 and multiplied by 10* 


Y. ’ 

1.55 ^ 

1.56 

1.57 j 

1.58 j 

1.59 

1 

T,(l - TO I 

1 

7 1 

30 

41 

40 
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CHAPTER 12 


ABANDONING AN EXPERIMENT PRIOR TO COMPLETION 

1. INTRODUCTION 

Every experiment is designed in the light of certain presumptions 
about the underlying phenomena to be studied, if only the presumption 
that the phenomena warrant study. It is not always possible, however, 
to confirm these presumptions in advance. In such cases it may be 
desirable to introduce a sequential element into the design of the experi- 
ment so that the experimental program can be adjusted to any facts 
about the basic assumptions disclosed during the course of the investiga- 
tion. The present chapter considers a simple design of this type, where 
an experiment is to be undertaken to estimate a parameter of a continu- 
ous distribution, but provision is to be made to abandon the experiment 
prior to completion if the accumulated evidence at any stage reveals that 
the underlying population docs not warrant study. 

1.1. Nature of the Problem 

The circumstances giving rise to the need of an experiment that 
provides for possible abandonment are these: A new mechanism has been 
constructed whose performance, in functioning models, is thought to be 
superior to that of similar standard mechanisms. It is accordingly 
desired to determine the average and v’ariability of a particular perform- 
ance characteristic from an experiment of sufficient, size to give reliable 
estimates of these parameters. There is reason to fear, however, that the 
proportion of breakdowns may be prohibitively high, in which case the 
mechanism cannot be used in its present state of development and 
the estimation of its performance parameters is of little value. More- 
over, because the experiment will be costly in time, personnel, and equip- 
ment, considerable saving will result from discontinuing the experiment 
at an early stage if the mechanism exhibits too high a failure rate. An 
experiment is therefore desired that incorporates the folloudng provisions: 
(1) If the failure rate exceeds a certain tolerance standard, there must 
be a preassigned degree of assurance of rejecting the mechanism and 
terminating the experiment; (2) if the failure rate is below a certain 
‘^acceptable standard, there must be a preassigned degree of assurance of 
completing the experiment; (3) the experiment should cease at the 
earliest point at which the accumulated evidence is sufficient to reject 
the mechanism with the required degree of assurance. 

3^5 
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1.2. Given Features of the Experiment 

Previous investigation of the mechanism appears to justify the 
assumption that the performance characteristic under study is normally 
distributed about some unknown average v'alue. Alc^reover, from pro- 
visional figures it appears that a satisfactory balance betw'een the cost of 
the experiment and the precision of the ^stimates^ can be obtained by a 
2 X 2 X 2 X 2 factorial experiment involving duplicate observations, 
that is, from 32 observations. Certain details of the experiment can thus 
be specified at once. If the mechanism has an acceptable failure rate, no 
fewer than 32 items can be tested, since 32 measurements of performance 
are required; on the other hand, no more than 32 functioning items need 
be examined, since these will yield the required number of measurements 
for estimation with the minimum amount of testing. Thus the criterion 
for accepting the mechanism can be represented graphically as a straight 
line by plotting the number of items that fail against the number of 
items tested. This acceptance line intersects the base line at 32, showing 
that no fewer than 32 items can be tested; it has a slope of 1, showing 
that if failures occur, the number of items tested shall be only sufficient 
to yield 32 performance measurement.s. As the experiment proceeds, ii 
point can be.plotted after each test representing the cumulated number 
of failures and the number of tests made; when such a point reaches ths 
acceptance line the experiment is complete, for 32 performance measure- 
ments have been obtained. 

1.3. Statistical Problem 

If several hundred trials'are made without obtaining the 32 perform- 
ance measurements needed to complete the experiment, it is obvious 
that the failure rate is excessive and the experiment ought to be aban- 
doned. This suggests the advisability of introducing a rejection line, 
showing for each number of items tested the number of failures that 
would justify rejecting the mechanism and abandoning the experiment; 
the rejection line should intersect the vertical axis above 0 and have a 
slope less than 1. The two lines together yield a clo-sed region such that, 
if the point representing the number of failurc-s and the number of items 
tested crosses the upper line, the mechanism is rejected and the experi- 
ment abandoned; while if the point crosses the lower line, the mechanism 
is accepted and estimates are made from the resulting 32 measurements. 

Since the lower line is fixed by the conditions of the problem, the 
statistical problem that remains is clearly to determine the upper line in > 
such a way as to meet preassigned requirements on the probabilities of 
abandonment and completion, with a minimum average amount of test- 
ing. No general solution to this problem has been found. The following 
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discussion will show, however, that sequential principles* can be used to 
give a good approximation to the solution. 

To formulate the problem more precisely, we assume that a proportion 
of failures exists that is considered unacceptable;'that is, if the failure 
rate equals or exceeds p 2 , we wish to reject the mechanism. If the failure 
rate is less than ^ 2 * 7 however, we are nulling to accept the mechanism; and 
in particular, if it is less than some value pi, we uush a high degree of 
assurance of accepting the mechanism. 


Number of 
failures (d) 



2. PROPOSED SOLUTION 

2.1. Approximating the Rejection Line by Sequential Principles 

The use of sequential principles to meet these requirements is sug- 
gested by the desire to minimize the necessary amount of sampling. A 
sequential criterion makes it possible to reappraise the failure rate of the 
mechanism after each test and to detenuiue on the basis of the accumu- 
lated evidence whether (a) to reject the mechanism, (6) to accept it, or 
(c) to continue the experiment- As soon as the accumulated evidence 
is sufficient for decision (a) or (5), the experiment stops and further, 
unnecessary experimenting is avoided. The usual sequential test, how- 
ever, consists of both an acceptance criterion and a rejection criterion, 
whereas completion of the test under consideration requires only a 
rejection criterion. What. we seek, therefore, is a sequential test which 
makes no provision for acceptance but which achieves certain assigned 
probabilities of rejection for the specified failure rates pi and pa- Having 
found such a test, we can provide for actual acceptance by combining 
* See Chap. 17 for a brief account of sequential analysis. 
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our sequential rejection criterion with the predetermined acceptance 
criterion, taking care to allow for the effect of this combination on the 
total probabilities of rejection. 

The desired sequential rejection criterion can be derived as a special 
case of the ordinary sequential binomial test. The ordinary test can be 
represented on a chart similar to Pig. 12.1 by a pair of parallel straight 
lines having a slope s and intercepts —hi and A*. A sequential test which 
provides only for rejection, that is, which consists solely of the upper 
decision line, may be rcgaidetl as a limiting case of an ordinary sequential 
hinomiai test with hi = «> . This conception enables us to use the for- 
mulas for the usual two-decision test to obtain the operating-character- 
istic (OC) curve of a cne-decision sequential test, that is, the probability 
of acceptance Lp as a function of the true population proportion of 
failures p. When hi = « , the OC curve is given by* 


and by 


a 


Up 

1 

Rp \ 

■when p < 8 

0) 

II 

1 

when p > 8 

(2) 


Thus, the probability of rejecting is 1 if p > s; it lies between 0 and 1 if 
p < s. Accordingly, we take the value p*, representing the failure rate 
above which we want to abandon the c.xpcriment, as the slope s of the 
one-decision sequential test. Then if a is the risk we are willing to run 
of abandoning the experiment and rejecting the mechanism w'hen the 
true failure rate is only pi, we may substitute pi for p, a for Rp, and pg 
for « in equation (1) and solve for As-t 


2.2. Adjusting the Rejection Line to Take Account of the Acceptance Line 

Having determined the one-decision sequential test that yields the 
requisite probabilities of rejection, we now take into account the accept- 
ance criterion resulting from the conditions of the experiment. This 
acceptance criterion affects the probabilities in two respects. (1) The 
probabilities of rejection will be decreased, since those samples which 

* See Statistical Research Group, Sequential Analysis, Appendix li, equations 
(R.80) and (B.81). (For full citations, see Sec. .5.) 

t An approximation to hi can be obtained by replacing p* of the formula 



(Sequential Analysis, See. 2. equation 2.204) by p% -H (p* — pi) * 2pi — pi. 
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would lead to late rejection will not be rejected at all (in fact, will now be 
accepted); (2) for every value of p < 1, whether or not p > s, the 
probability of acceptance \nll be greater than zero. The net effect of 
the acceptance line is thus to increase the chances of acceptance for all 
values of p < 1. This means that Lp^ (= 1 — Rp^) will now be positive; 
while Rp^ will be less than a. The decrease in Rp^ is, of course, desirable, 
but it can be attained only at the cost of additional testing beyond that 
necessary to maintain Rp^ at the required lev'el a. It remains therefore 
to readjust the decision lines so that Rp^ will be a and Lp^ will be at an 
acceptably low level, say 

Since the acceptance line is fixed by the conditions of the problem, the 
necessary changes in the decision lines must be made entirely in the 
rejection line. It is apparent that the probabilities of rejection can be 
increased either by reducing ht or by reducing «, or both. It is not clear, 
however, what combination of adjustments will give the desired risks 
or and /S with a minimum amount of inspection. We therefore resort to 
trial and error to find a combination of h* and $ that gives the desired 
probabilities of acceptance, leaving unsettled the question whether this 
combination of hi and s is the best possible from the standpoint of the 
average amount of testing. Fortunately, tliis tiiul-and-error process can 
he carried out without too much difficulty, for a straightforward pnethod 
exists for computing the OC curve for any binomial test of the sort here 
described. Thus, by determining the OC curve corresi)onding to each 
of a number of combinations of lit and s, that combination can be chosen 
which gives the requisite probabihties oi acceptance at pi and pi. Thi.s 
I)roceduro will yield a plan for the experiment which, though probably 
not optimum from the standpoint of minimizing inspection, will serve as 
an approximation to the type of plan desired, that is, lead to early 
abandonment of the experiment if the true failure rate is high; moreover, 
the OC curve will be available, so the consequences of using the plan will 
be fully known. 


3. AN EXAMPLE 

To illustrate the method of solution outlined in Sec. 2, lot us suppose 
that if as many as half the mechanisms arc failures we ^^■i3h a high degree 
of assurance of abandoning the experiment and rejecting the proposed 
model, if as few as 40 percent are failures w'c wish a high degree of assur- 
ance of completing the experiment. Let the desired probability of 
completing the experiment if the failure rate is as high as 50 percent be 
/3 = 0.10, and the probability of abandoning the experiment if the failure 
rate is as Ioav as 40 percent be a = 0.10. 

The lower, or acceptance line is determined by the requirements for 
estimating the performance parameters, as explained above; its equation 
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is 

rfi = -32 + JV (3) 

where di represents the cumulated number of failures and N represents 
the number of tests made. v 

The first approximation to the rejection line is giv'en by the onc- 
decision sequential test for which s = 0.5 and /<2 la obtained from 


0.5 



0.^ O ' *; - ' 

(4) 


0.1 - 1 


Writing 

j 




(5) 

we have 

X®* — 1 1 

0 4 

X - 1 x® » + 1 

(ti) 


x®s = 1.5 

(7) 


X =. 2.25 

(8) 

Then, from (5), 

. -log 0.1 

log X 

(9) 


1 


log 2.25 
= 2.84 

A moment's reflection on the orientation of the line dj = 2.84 + 0.5N 
on the graph relating number of failures to number of items tested shows 
that so long ass = 0.5, all values of A satisfying the inequality 2.5 < < 3 

are equivalent, since observed values of d and N must be integers. In 
view of this, and because we exjject this first approximation to yield too 
large probabilities of acceptance, we place the initial value of ht at 2.5. 
The first approximation to our test is thus defined by the two straight 
lines with equations 

dj = 2,6 + O.SiV (rejection line) (10) 

di = —32 + N (acceptance line) (11) 

However, this combination fails to give a satisfactory OC curve, the 
values of Lp being excessive throughout the range of p. On the other 
hand, the combination hi = l.C and s = 0.4 giv^ values of Lp that are 
too small, and so also do the combinations hi = 1.5, s = 0.5 and hz = 2.2, 
s = 0.4. A fifth set, ht = 2.6 and s = 0.4, gives the following OC 
curve, which, though departing from that originally specified,; appears 
satisfactory. 
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I’ro portion 

Probability of 

of failures 

completing experiment 

0.1 

1.000- 

. 0.2 

0.990 

0.3 

0.904 

0.4 

0.532 

0.5 

0 102 

0.6 

0.003 


4. CALCULATION OF OC CURVE 

The method of calculating the OC cur\'e for any particular experi- 
mental plan of the type described is discussed at length elsewhere,* so 
it mil be outlined here only in general terms. 

The basis of the method is the fact that in any truncated sequential 
test, the number of possible outcomes in sampling is finite and, in practical 
cases, fairly small. It is therefore possible to enumerate all possible out- 
comes of the test and to determine the total probability of those outcomes 
which lead to acceptance, that is, the value of Lp. 

This calculation is accoraplishe<l stop by step, as follows: For the first 
stage of the experiment, all possible ways in which the sample might 
turn out are specified, and the probability of each outcome is computed 
on the assumption that the true failure rate of the mechanism is some 
particular value, say pt. These outcomes are then classified into two 
groups, those which lead to acceptance an<l those which lead to the 
decision to continue testing. The sum of the probabilities of the first 
class gives the total probability of acceptance at the first stage of the 
experiment. Each outcome in the second class is then considered as a 
possible point of departure for the next stage of the experiment; and for 
each such point of departure, the possible outcomes of the second stage 
are considered and classified as before. The sum, over all points of 
departure, of the probabilities of those outcomes which lead to acceptance 
at the second stage then gives the total probability of acceptance at 
stage two, while the sum of such probabiliti^ over both stages gives the 
total probability of acceptance for tlie first two stages. This basic 
method of calculation can be carried through the remaining (finite num- 
ber of) stages of the experiment. 

The total probability of acceptance taken over all stages represents 
the probability Lp^ that the experiment will lead to acceptance when the 
true failure rate is pi. By systematic methods these calculations can be 
duplicated for a choice of different values of p, so that a sequence of 
values of p and Lp sufficient to determine the entire OC curve, or at least 
those points of principal interest on the OC curve, can be determined. It 
is in this fashion that the points on the OC curve in Sec. 3 were determined. 

* Statistical Research Grmip, Sampling InspfClion, Chap. 17, Sec. 2, pp. 187-202. 
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This method of attack yields only one of many possible tests of the 
sort described, all having the same probabilities Z/p^ = O.QOandLp^ = 0.10. 
The optimum test may thus be viewed as the particular one of these 
tests which requires the smallest average amount of inspection for the 
relevant range of p. By sufficient calculation this test might be deter- 
* mined by trial and error, since the probabilities used to determine the 
OC curve of a test suffice to calculate the curve representing the average 
amount of sampling as a function of the failure rate p (the ASN curve).* 
If, therefore, we were to determine a whole class of tests with the same 
Lpj and Lp^, we could choose that one whose ASN curve showed the least 
average cost in sampling in the relevant range of p. However, the 
volume of calculation necessary to use this approach renders it impractical. 

6. REFERENCES 
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CHAPTER 13 


PLANNING EXPERIMENTS SEEKING MAXIMA 
1. TYPE OF PROBLEM 

This chapter deals almost entirely with a special class of experiments, 
namely, those designed to determine the conditions for which some func- 
tion attains a maximum. For example, experiments may be conducted 
on the breaking strength of a type of alloy to determine the composition 
producing maximum strength. It is not the primary object of such 
experiments to determine the functional relation between strength and 
composition, nor even to measure the strength, maximum or otherwise; 
the primary object is to find a particular combination of the independent 
variables at which the maximum of the dependent variable is nearly 
attained. Although the planning of experiments has become a major 
brancih of statistics, little attention has been given to this important class 
of problem, which is especially common in engineering and development 
work. * 

For concreteness, this chapter considers the specific problem of 
planning a metallurgical experiment to find the best composition of a 
certain type of alloy for maximizing the time to rupture under a given 
stress at S given elevated temperature. Clearly, tlio principles elucidated 
in terms of this particular problem are applicable to a wide class of 
problems. 

2. PURPOSES OF EXPERIMENT 

The problem considered is one in which a single observable result 
(number of hours it takes a specimen to rupture) is a function of many 
independent variables (method of treating the alloy, chemical composi- 
tion of the alloy, and so forth). An experiment .is to be conducted in 
which the result is to be measured for a series of values of the independent 
variables. 

Such an experiment is likely to have two somewhat different pur- 
poses: (1) To find the values of the independent variables that make 
the function (that is, the observable result) a maximum ; (2) to evaluate 
the function in the neighborhood of the maximum. At the present stage 
of metallurgical knowledge, finding the maximum is usually the primary 
purpose. There is reason to belie-vm that nothing like the maximum 

* The pathbreaking work on the problem is that of Hotelling, ''Experimental 
Determination of the Maximum of a Function.” (For full citations, see Sec. 6.) 
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possible strcngtb bas yet been attained; and the theory of the subject 
i? so undeveloped as to make direct experiment the most fruitful approach 
toward finding stronger alloys. Moreover, there is relatively little 
interest in knowing the behavior of the function in regions rather distant 
from the maximum. 

If the function has more than one maximum, the ultimate objective 
is to find the largest maximum — the absolute maximum. In general, 
however, this objective is unattainable' without complete knowledge of 
the entire function. Such knowledge can seldom be secured experi- 
mentally, and almost certainly not in n single experiment. The dis- 
cussion that follows therefore assumes a more modest objective, the 
determination 6f a local maximum. 

Although the location of a maximum is of primary importance, 
mapping the function in the neighborhood of a maximum is important 
for several reasons : 

(1) Typically, maximization of the particular dependent variable 
measured in a given experiment is only one of several desiderata in 
choosing an alloy, so it is important to know how much would be sacri- 
ficed if the independent variables were altered to satisfy other require- 
ments. For example, the combination of independent variables that 
gives the highest time to rupture may give in.sufficicnt ductility. It 
might then be desirable to know how much strength would be sacrificed 
by various changes designe<l to increase ductility. 

(2) Knowledge of the relative importance of different independent 
variables is valuable in designing other experiments to find other maxima. 

(3) Knowledge of the function in the ‘region of a maximum may 
contribute to an understanding of the mechanism at work and may thus 
advance theorcticai knowledge. 

(4) It may not be possible to control the independent variables as 
closely in production as in laboratory experiments. Knowledge of the 
function in the neighborhood of a maximum will make it possible to 
judge the seriousness of departures from control. 

3. DEFICIENCIES OF FACTORIAL DESIGN 

The factorial design is ideally suited for experiments whose purpose 
is to map a function in a preassigned range of values of the independent 
variables.* The fact that the region is preassigned means that it is 

• The term "factorial design” is used in this chapter to refer to an exprrjincntal 
design in which a limited number of levels of each independent variable arc selected 
in advance and at least one test is made for each combination of the selected levels of 
the independent variables. See Fisher, Design of Experimenls, Chap. VI, The 
Factorial Design in Experimentation. 

The factorial design is in a sense the extreme example of a class of designs having 
in common the selection in advance of the values of the independent variables at whii h 
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feasible to lay out the design completely and specifically in advance 
of the experiment; the fact that the bcliavior of the function is desired 
for all possible combinations of the independent variables means that 
the experiment must represent all combinations in some way, which a 
factorial design does. 

For the purposes described in the preceding section, however, the 
factorial design has certain deficiencies: 

(1) It devotes obsei-valions to exploring regions that may turn out, 
in the light of the results, to be of no interest because they are far from a 
maximum. 

(2) Because it seeks to explore a given region comprehensively, it 
must either explore only a small region, or explore a large region very 
superficially. If a small region is explored, it may turn out to contain no 
local maximum. The experiment would then at best indicate the direc- 
tion in which to move in conducting a new e.xperiment. If a large 
region is explored, it may be explored so superficially that a maximum 
may be missed entirely, or, if found, Tvill be known .so imperfectly that an 
additional experiment is required. 

(3) The factorial design has the disadvantage, somewhat less funda- 
mental than the preceding, that it neglects the fact that some of the 
variables are continuous and some, though discrete, are ordered. This 
deficiency could, however, be remedied while retaining the basic prin- 
ciples of the factorial design. 

4. A SEQUENTIAL DESIGN 

These deficiencies of the factorial design suggest that an efficient 
design for the present purpose ought to be sequential; that is, o\ight to 
adjust the experimental program at each stage in the light of the results 
of prior stages. This section outlines a particular sequential design, 
primarily to illustr.ate the direction that seems desirable in the design of 
metallurgical experiments of the type here considered. 

Siep 1. Select some particular combination of independent variables 
as a starting point. The combination selected should be the best advance 
estimate of the optimum combination. 


observations are to be made. Other designs in this class may, in any particular 
instance, be more economical than a complete factorial and preferable to it. Economy 
can be gained without loss, however, only if additional knowledge is available in 
advance (for example, knowledge that certain interactions are negligible). 

JIany of the remarks in this chapter are applicable to these other designs as well 
as to tho complete factorial. However, the chapter ronsiders explicitly only the 
complete factorial design in order to have a sharp and definite centrost and to avoid 
complications and qualifications that have little bearing on the main issue raised in 
this chapter. 
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SUp 2. Arrange the independent variables in some order. 

Step 3. Make tests at the original starting point and at a series of 
points differing only in the value assigned the first independent variable, 
the other variables being held constant.* From this series of experi- 
ments, estimate the value of the first independent variable that maximizes 
time to rupture, t If the independent variable is continuous, it will 
probably be best to find the maximum by some such device as fitting a 
polynomial to the observations. 

Step 4. Holding the first independent variable fixed at the maximiz- 
ing value found in step 3 and the other independent variables, except the 
second, at the values originally assigned to them, repeat step 3 with the 
second independent variable- Repeat this process with the third, fourth, 
. . , , independent variable. 

Step 5. After all variables have been varied (call this a “round” of 
experiments), the whole process can be repeated, except that the original 
starting point is replaced by the combination of values of the independent 
variables reached at the end of the first round. 

Successive rounds will clearly converge to the neighborhood of a local 
maximum, with perhaps a few “pathological” exceptions; for, aside from 
statistical fluctuations, each round and each step witliin a round neces- 
sarily represent an improvement. The rate at which the improvements 
decline from round to round is likely to give some idea of how much 
further progress is possible and some indication of the value of additional 
rounds. The proce-sa of convergence may perhaps be speeded up after 
one or more complete rounds. For example, after the second complete 

• For the present purpose the precise meaning to be attached to “the other vari- 
ables being held constant” is irrelevant. For variables representing chemical 
composition, it can be interpreted aa meaning that the relative proportions of the other 
variables are held constant. Alternatively, for all but one variable, it can be inter- 
preted as meaning that the percentage a particular element forms of the total is lield 
constant. Any combination of these two will also do, provided the method of holding 
other variables constant is followed consistently. 

t If the independent variable is ordered, this process also could be sequentialized, 
with obvious advantages- For example, testa could be made (a) at the original start- 
ing point and (b) at a single other value of the first independent variable. If the 
tests at (6) gave a (significantly) higher time to rupture than the tests at (o), other 
tests would be made by moving still farther in the same direction from the original 
starting point. If the tests at (6) gave a shorter time to rupture, the next tests would 
be made by moving in the opposite direction imm the starting point. This process 
would be continued until a value w'ne found higher than its neighbors in both direc- 
tions. This aspect of a sequential procedure is not considered in detail here because 
it is not germane to our main point and because practical considerations having to do 
with full use of experimental equipment may make it undesirable to sequentjalize the 
experiment fully. Even though this phase of the experiment is not sequentialized, 
there is a real problem about designing it efficiently. See Hotelung, “Experimental 
Determination of the Maximum of a Function.” 
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round it might ho doMrable to move along the vector defined by the end 
points of the first two rounds, instead of varying the variables according 
to the original pattern. After one such step, the original pattern could 
be used again. 

It will clearly be desirable in the earl^' rounds to use rather broad 
intervals in varying each independent variable and to locate the maximum 
only very approximately. Finer and finer intervals should be used in 
later rounds as the maximum is approached. A consequence of this is 
that the process will provide only a very rough mapping of the function 
in regions far removed from a maximum, but a relatively fine mapping in 
regions near a maximum. The mapping of the region in the neighbor- 
hood of a maximum can, if desired, be filled in by a supplementary 
experiment, perhaps of factorial de.sign, after the neighborhood of the 
maximum has been delimited with sufficient accuracy. 

It may be worth repeating that nothing more is claimed for this out- 
line of a sequential design than that it Is suggestive. Numerous prob- 
lems would arise in applying it to an actual experiment, and there are 
many possibilities of increasing its efficiency. The suggested sequential 
design is in large part simply an abstract and systematic statement of a 
rather natural, obvious, and common method of locating a maximum or 
minimum of a function of many variables. 

6. COMPARISON OF FACTORIAL AND SEQUENTIAL DESIGNS 
6.1. Number of Observations 

The great advantage of a sequential design over a factorial design ia 
that it will concentrate observations in the neighborhood of a maximum. 
This advantage is likely to be greater, the lai^cr the number of inde- 
pendent variables and the larger the number of values of each independent 
variable at which observations are taken. Let n be the number of 
variables and suppose that obser\'ations are to be taken at k values of 
each variable (for the sequential design, these need not be the same 
values in successive rounds). Then a complete factorial design without 
replication will require A"* observations. A single round of the sequential 
design without replication will require kn observations. The observa- 
tions required for a factorial design will therefore permit k'^fkn^ k^'^Jn 
rounds, w’hich increases with n and with k. The number of rounds 
required under the sequential design will decrease as k increases, since the 
maximum at each step would be determined more accurately. We do not 
know how the number of rounds required under the sequential design 
varies with n — nor indeed is it easy to see how to state this question 
precisely. We expect, however, that the number of rounds required will 
not depend very sharply on n but will depend primarily on (n) the close- 
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ness of the original starting point to the optimum eombination and (b) 
the size of the experimental error relative to the differences it is consid- 
ered important to detect. 

Consider a simple 5 X 3 X 3 X 3 factorial design, that is, one involv- 
ing four independent variables, with five values of the first and three 
values of each of the others. Such a design requires 135 observations, 
without providing for replications. A single round of the sequential 
design, covering the same number of values of each independent variable, 
would require 14 observations. It would therefore be possible to make 
almost 10 complete rounds with the number of observations required for 
the factorial experiment. Fewer than 10 rounds should suffice if the 
original starting point is reasonably close to the maximum. More rounds 
might be required if the original starting point were far from a maximum; 
but if so little information about the location of a maximum were avail- 
able, a factorial experiment might well prove fruitless. 

As another example, consider an experiment to determine the opti- 
mum composition of the high-carbon vitallium-type alloys with respect 
to elements that have been included in various tests of this type of 
alloys. At least ten elements have been included in one or another trial 
composition. This gives nine independent variables, since the sum of the 
percentages must add up to 100. Suppose we are willing to use only 
three levels of each element. A complete factorial design without 
replications would then require 3®, or 19,083, observations. A single 
round of the sequential design without replications would require only 
27 observations, so that it would )>c possible to make 729 rounds with 
the number of observations required for a complete factorial design. 
Five rounds, with duplicate observations at each level on each round, 
would require only 270 observations, or less than 1.5 per cent of the 
number required for a complete factorial design without replications. 
As this example indicates, the^ advantage of the sequential design in 
terms of number of observations is likely to become extremely great as the 
number of variables increases. And, it should be noted, the metal- 
lurgical problem in question does in fact involve many variables. Thu 
example cited is certainly conservative, since, in addition to the ton 
chemical elements, the strength of the alloy is likely to be affected by the 
solution and aging treatments, the methods of casting or of forging, and 
so forth. 

It should be recognized that the additional observations obtained 
in the factorial experiment are not useless. They provide information 
about the behavior of the function in regions removed from a maximum, 
about the relative importance of the variables, and about their inter- 
actions. This information is likely to be valuable in choosing new 
regions within which to search for maxima and in deciding on the vari- 
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ables on which to concentrate in preliminary experimentation. More 
important still, the observations some distance from a maximum may, 
under some circumstances, tell something about the behavior of time to 
rupture in the neighborhood of that majdmum; perhaps the most com- 
mon circumstances when this occurs are when (a) interactions are small, 
or (6) there is available a fairly good approximation to the mathematical 
form of the function, involving relatively few parameters. 

With respect to proviso (a), work on metallurgical problems suggests 
that interactions rarely are small. Furthermore, while the efficiency 
of a factorial design for finding a maximum is greater if there are no 
interactions than if there arc interactions, so is that of a sequential 
design. If there are no interactions, a single round of the sequential 
experiment mil, except for statistical fluctuations, lead directly to the 
maximum. Statistical fluctuations mean that successive rounds will not 
lead tQ exactly the same point; but they will tend to give much the same 
time to rupture, and it should become clear fairly quickly that one is in 
the immediate neighborhood of a maximum. Moreover, in the absence 
of interactions, data from successive rounds can be combined to give a 
better estimate of the maximum. 

Proviso (b), that there be available a good approximation, involving 
relatively few parameters, to the mathematical form of the function, is 
rarely satisfied. But if it is, neither the standard factorial design nor the 
sequential design suggested in Sec. 4 is appropriate. The problem then 
is to determine as accurately as possible the values of the independent 
variables that maximize this function. These maximizing values depend 
upon the parameters of the function; the optimum design for this pur- 
pose thus depends on the form of the function and on the approxi- 
mate values of its parameters. Probably the best plan is to conduct a 
small preliminary experiment to get a general idea of the values of the 
parameters and to use this information in designing a larger experiment.* 

5.2. Time Trends 

One real advantage of the factorial design is that it is possible, through 
proper randomization, to prevent the introduction of bias from any time 
trends that may be present. Time trends will, indeed, reduce the power 
of the factorial experiment to detect the effects that it is designed to 
measure, but they will not bias the conclusioi^. The sequential plan, on 
the other hand, is very much at the mercy of time trends; and great care 
would have to be taken to see that none crept in. Measures that might 
be adopted would include (a) running control specimens of constant 
composition along >vith the test specimei^; (6) keeping a running record 

• See Hotelling, “Experimental I>etermination of the Maximum of a Function.” 
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of differences between duplicate specimens to detect changes in experi- 
mental error. 
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CHAPTER 14 


PROBABILITY THAT SAMPLE MEANS ARE IN OPPOSITE ORDER 
TO POPULATION MEANS 

1. INTRODUCTION 

When N objects are drawn independently at random from each of 
two populations in which some measurable characteristic x of the objects 
is distributed about mean values mi and mj, what is the probability that 
the larger of the two sample means xi and xz will correspond with the 
population having the smaller mean? In other words, if a decision 
about the sign of mi — mj is based on the sign of Xi — xt, what is the 
probability that the decision will be wrong? 

Such a question arises if two alternative sources Si and St (for exam* 
pie, processes for making, procedures for treating, genetic strains) yield 
objects of a certain kind, and the worth of each object is determined by 
the value of some measurable characteristic x that varies about an aver- 
age mi for objects from jS'i and about an average mj for objects from 5s. 
If mi and mj were known, a decision to adopt Si or Sz would be deter- 
mined (completely) by the sign of mi — m*; that is, 5i or Ss would be 
chosen according as mi exceeds or does not exceed mj. When mi and 
are unknown, it is natural to base the decision on the sign of xi — xs, 
where and Xj are the average values of x for N objects drawn inde- 
pendentJy at random from Si and St, respectively. Such decisions will 
be wrong, that is, opposite to the decision that would be made if mi and 
mj were known, whenever the sign of xj — Xj is opposite to that of 
mi — mj. Consequently, it is of interest to know the probability of such 
an occurrence and how this probability depends on the sample size N 
and on the absolute magnitude of the true difference, |mi — mij. 

In Sec. 2 the probability of xi — Xj having its sign opposite to that 
of mi — mj is evaluated, and its dependence on N and |mi — mgl studied, 
for the case where x is normally distributed about mi with a standard 
deviation of o-i for objects from Si, or about mi with standard deviation 
az for objects from Sz- In Sec. 3 attention is given to the question of 
how large N should be in order that the risk of a wrong decision be less 
than 0 whenever [mz — mi[ exceeds D, say. The results given in Secs. 2 
.and 3 are applicable, to a good approximation, in cases ivhere x is non- 
normally distributed for objects from 5i or Sz, provided the distributions 
of X have finite standard deviations, which is generally the case in prac- 
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tical work, and N is sufficiently large. For sample sizes of 4 or larger 
the approximation will generally be adequate for most practical purposes 
when ffi and are knoun. When <ri and <rj are unkno\vTi and N is not 
less than 30, ai and may be replaced by their estimates from the 
samples 


9i 


2 4 - 
--1 


(2 -) 
. = 1 


N{N - 1) 


a = 1 , 2 ) 


( 1 ) 


and the results of Secs. 2 and 3 will not be seriously affected. In Sec. 4, 
the conditions under which the sign of xi — Xj provides the “best” 
decision function for choo-sing between and S 2 are stated, and the 
problem of choosing a best decision function in other circumstances is 
discussed briefly. 


2. PROBABILITY FUNCTION 

Let f 1 and xj denote the means of N observations drawn independently 
at random from each of two normal populations •with means rrii and mt 
and standard deviations <ri and <rt, respectively. Then in repeated 
sampling xi — fj will be normally distributed about a mean lUi — 1712 


TABLE 14.1 

Probability P(i,N) That Sample MeaKS Will Be ik Opposite Order to 
P0PC1.ATION Means fob Selected Valdes of S and N 


Absolute difference 


Number of obeervatione in each aampte (N) 


between population * 


means in a units* 

2 

4 

6 

8 

10 

12 

16 

20 

50 

100 

200 

0,00 

in 

8 

0 






mu 


0.500 

0 05 


jjKky 

0 465 

0.460 

0.455 

0.45! 

0.444 

0 437 


0 362 

0,309 

0,10 


iESSm 

0.431 

0.421 

0.412 

0 403 

0 339 

0,.176 


0 240 

0 159 

0.15 

SfM 

0,41fl 

0 398 


0 369 

0 357 

0 336 

0.318 

0,227 

0 144 

0.067 

0 20 

ffwfl 

0.3S9 

0.365 

sg 

0.327 

0 312 

0.2S6 

0.264 

0 159 

bWASM 

U,023 

0 25 


0 362 

0.333 


0.288 


0.240 

0 215 

0,100 

0 039 

D OOC 

0.30 

0 382 

0 336 

0.302 


0.251 

willl 

0.198 

0,171 

0 0C7 


0 001 

0.40 

0.345 

0.286 


ilWfl 


■IIMI 

0 129 


0.023 


fiwrgnn 

0 50 



0.193 

0.159 


■11 [)l 






0 75 

0.227 

SO 

0 097 


'VifrJ 

I'.m 






l.OO 

0.150 

01 

[0.042 


0 013 

■Kt.vrl 

SHtWI 





1.25 

0 IOC 


0 015 


0 003 


0.0002 





1.50 

0.0137 


Tvrnii 


0.0004 

■Ri.iliil 

O.OOOiJ 





1 75 





ilim 







2.00 












2.50 

0 006 











3.00 


IH 











* Let mi and ei denote ibe mean and standard deviation of the erst population, mi and ei denote the 
mean and standard deviation of the second population, and let v* = (vi> + then < ■ [mi — 
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with standard deviation a y/2/N where 

^ i « 

, <rf + aj 


( 2 ) 


Consequently, the probability that the sign of £i — will be opposite 
to that of nil — rrii is 


• 

P(5,i\r) - / e ^di 

la 

(3) 

where 


^ jmi — -mil 

dT 

(4) 

and 



(5) 


P{8,N) is tabulated to 3 decimals (occasionally 4) in Table 14.1 for 
5 = 0 to 0.30 by steps of 0.05, 0.30 to 0.50 by steps of 0.1 0, 0,50 to 2.00 
by steps of 0.25, 2.00 to 3.00 by steps of 0.60; and for iV = 2 to 12 by 



Fio. 14.1. — Probability that means of samples from two normal populations will be in 
opposite order to populatioa means. 
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steps of 2, 16, 20, 50, 100, 200. For example, P(0.50,10) = 0.132, which 
signifies that, with samples of 10 observations from each of two popula- 
tions whose means differ by ct/ 2, the probability of the sample means 
being in opposite order to the population means is 0.132, This event 
may be expected to occur, therefore, more than 1 time out of 8 in the 
long run, under such circumstances. Clearly it is risky to base decisions 
on the sign of xi — xt for samples of only 10 observations each *vhen 
differences of c/2, or less, between population means are of practical 
importance. 

In order to portray better the dependence of P(8,N) on 8 and on N, 
P(8,N) has been plotted against & in Fig, 14.1 for iV = 2, 4, 10, 20, 50, 
100, and 200. From those curves it is clear that decisions based on the 
sign of xi — X2 will rarely be incorrect when (mi — nisj exceeds 2 (t (S = 2), 
even for samples of only 4 observations each. On the other hand, if an 
incorrect decision is of practical importance when jmi — mj] = c/2, and 
if it is desired that the probability of an incorrect decision not exceed 
0.01 under these circunistanccs, then about 50 observations from each 
population bo needed as a basis for decisions. 

3. SAMPLE SIZES 

If wc choose a probability ^ of making an incorrect decision (a 
decision based on the sign of £i — it different from that which woilld b(5 
made if the sign of mi — were known) and define K, by 

^ / c 2 d/ = e (6) 

V-ir jKt 

then, from (3), (4), and (5) it follows that 

(mi - W2I IJV rr 
— ; — 

determines, for a given and <T, the value of Iwi — mil for which the prob- 
ability of an incorrect decision is or, for a given value of |mi — mil/cr, 
the value of N that will be needed if the probability of an incorrect 
decision is to be 18. Values of Kf can be obtained from Table 1.1 of 
Chap. 1, or values of /3 corresponding with various values of K from 
Table 1.5. 

For example, if an incorrect decision is serious when jmi — mil = c/2, 
and if it is desired to limit the risk of such an error to 0.01 under these 
circumstances, then (7) implies that at least 44 (8 X 2.3203* = 43.3) 
observations will be needed from each of the populations. On the other 
hand, if the sampling has already been carried out, taking only 30 
observations from each population, it may be some consolation to 
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know that the risk of an incorrect decision is only 0.05 when 
\mi - mil = 1.6449a-/'v/r5 = 0.42£r 

and is 0.01 when 

[mi — maf = 2 . 3263 (J'/'v/T 5 = O.OOo-. 

4. CONDITIONS UNDER WHICH THE SIGN OF Xi - £2 PROVIDES THE BEST 

DECISION FUNCTION 

In Sec. 1 it was stated that if a decision to choose Si or *82 would be 
determined (completely) by the sign of mi — mt if this sign were kno^vn, 
it is natural to base the decision on the sign of xi — Xi. This raises the 
question of whether the sign of ii — xa is actually the best function of the 
data upon which to base the decision. 

H. A. Simon has shown that when (a) x is normally distributed in 
each of the populations Si and Si, (fc) the standard deviation of x is the 
same (<ri = <12) in Si and Si, (c) there is no a priori basis for a choice 
between 5 i and Si without knowledge of the values of mi and mj (or, at 
least, of the sign of mi — mt), and (d) the choice between 5 i and 52 is to 
be based on some symmetric function of the observed values of an equal 
number N of observations drawn independently at random from Si and 
52 , then the probability of an incorrect decision will be a minimum, what- 
ever the values of mi and m3 and of the common value of ffj and Oi, if the 
decision to choose 5 i or Si is based on the sign of xi — X2. As we have 
seen above, the probability of an incorrect decision, when the sign of 
x\ — Xi provides the basis for decision, is determined completely by N, 
<r = (Ti = <n, and |mi — m2j under these conditions. 

When conditions (a), (c), and (d) above are fulfilled, but 0-4 7^ oz, 
then, Simon has found, there does not exist any symmetric function of the 
2N observations having the property that when the decision to choose 
between Si and 52 is based on the observed value of this function the 
probability of an incorrect decision will be a minimum whatever the 
values of mi and mz) this is tnie even when the values of ui and <72 arc 
known. This is the case a fortiori when the value of either <71 or <72 is 
unknown. He has found, however, that if it is agreed that (d') the choice 
between 5 i and 52 is to be based on some symmetric function of the 
differences xn — 0:21, xn — xa, • * • , Xw — Xis, then the sign of 
Xi — X2 is the decision function that minimizes the probability of error, 
whatever the values of mi and mz and of < 7 i and <72. 

When X is non-norraally distributed in one or both of the populations, 
then xi — Xi no longer furnishes Ihe most efficient estimate 0/ mi — mi 
and the sign of Xi — X2 will not be the best decision function upon which 
to base a choice between 5 i and 52, even when <71 = <72. Welch has dis- 
cussed the determination of the best discriminant function upon which 
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to base a choice between two populations when the form of the distribu- 
tion of X in each of the populations is knowm. 
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CHAPTER 15 


SIGNIFICANCE OF THE LARGEST OF A SET OF 
SAMPLE ESTIMATES OP VARIANCE 

1. TYPE OF PROBLEM 

When data relate to several different precedes, to several different 
products^ to a single process at different times, or to a particular type of 
product from each of several different sources, the analyst is frequently 
faced with the necessity of deciding ^Yhethe^ the observed differences in 
variability of the data within the respective classes are consistent with 
the supposition that the intrinsic variability is uniform, that is, the same 
for each class. -■ 

If the classes are not uniform in variability, then simple comparisons 
of the classes in other respects may be misleading. Thus, if the within- 
class variability diffei's greatly from class to class, the mean values for 
the respective classes of the variable under consideration no longer pro- 
vide an adequate basis for comparison, since a small mean associated with 
a large dispersion may imply greater frequency of occurrence of undesir- 
able values of the characteristic than will a larger mean associated with a 
smaller dispersion of individual values. In such cases it may be more 
i.iseful to compare the classes with respect to the probability of occurrence 
of an individual value greater than a specified upper limit U (as in 
Chap. 1) or with, respect to some other feature that takes into account 
both the average value and the variability of the characteristic in each 
class. In this connection it should be recalled that the customary F test 
of the homogeneity of class means, which consists of comparing the 
observed ratio of the between-class mean square to the pooled mthin-class 
mean square, is valid only when the intrinsic within-class variability is 
the same for each class. Indeed, a pooled estimate of within-class 
variability, obtained by combining measures of the respective within- 
class dispersions, may be useless for practical purposes, unless there is 
homogeneity of within-class variability or the method of combining the 
within-class dispersions takes proper account of the relative importance 
(for example, the relative frequency of occurrence) of the respective 
classes under realistic conditions. 

Of the various criteria that have been advanced for testing the homo- 
geneity of a set of variance estimates, the test proposed by Bartlett is 
generally considered to be the best one available of the “omnibus” 

dS5 
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variety.* * * § An omnibus test is one that has good discriminating poAver 
with respect to a large variety of alternatives to the null hypothesis. 
The customary F test of the homogeneity of a set of means is often used 
as an omnibus test. Tliis is the case when there are k means and the 
between-means mean square having A: — 1 degrees of freedom is com- 
pared with the error mean square. But “the statistician who does not 
know in advance with which type of alternative to [homogeneity] he may 
be faced is in the position of a carpenter who is summoned to a house to 
undertake a job of an unknown kind and is only able to take one tool 
with him! "Which shall it be? Even if there is an ‘omnibus' tool, it is 
likely to be far less sensitive at any particular job than a specialized one; 
but the specialized tool will be quite useless under the wrong conditions.”! 
It is therefore advisable in applications of the F test to isolate and test 
individually the mean squares corresponding to comparisons that have 
special interest a priori, or that represent comparisons between rational 
subgroups of the data that may have unequal (population) means for 
various a priori reasons. By thus adapting the F test to the circum- 
stances of the study involved, its discriminating power is improved, at 
least with respect to the alternatives to homogeneity that are believed 
to be the most likely to exist or to be of special importance if they do 
exist. Bartlett has pointed out that his over-all te.st for homogeneity of 
a set of variances can be separated, in similar fashion, into parts represent- 
ing comparisons of special interest between subsets of variance estimates, 
and the statistical significance of each part tested individually.! Like 
the F test for homogeneity of means. Bartlett’s test has been shown to be 
unbiased and to possess various other desirable properties.! AVhen the 
issue is homogeneity of variances, Bartlett’s test assumes the role played 
by the F test when the issue is homogeneity of means., 

Bartlett's test, though applicable, is somewhat inappropriate when 
the alternative to homogeneity that is most likely to represent the true 
situation, or that is of special importance when it docs obtain, is that the 
expected value of some one of the mean squares (variance e.stimates) 
substantially exceeds the expected values of the others, which may be 
homogeneous or not. By “some one” it is meant that prior to the 

• Babtlett, “Sufficiency and Statistical Tests,” especially p. 273. Also see 
Bishop and Nair, “Homogeneity of a Set of Estimated Variances”; Pitman, “Loca- 
tion and Scale Parameters”; and Hartley, “Homogeneity of a Set of Variances.” 
Bartlett’s test is described in the next section of this chapter; also in Bider, Slaiisiical 
Methods, Chap. 7, See. 51, where an illustration is given. (For full citations, see 
Sec. 5.) 

t Pear.son, “Efficiency of Statistical Tools,” p. 316. 

t Bartlett, “Examples of Statistical Methods,*’ especially pp. 158-159. 

§ Pitman, “Location and Scale Parameters,” especially Secs. 2 to 6; also Hartley, 
“Homogeneity of a Set of Variances.” 
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analysis of the data — or, better, prior to the collection of the data — there 
is no basis for identifying the anomalous one of the set. The several 
variance estimates may correspond, for example, to the several machines 
of a production line and represent the witliiii-inachiiie variability of 
products produced _by the respective machines, which variability may be 
expected to be the same from machine to machine unless one of the 
machines is out of adjustment, in which event the variability of products 
from this machine ^vill exceed that of products from other machines. 
Similarly, the several variance estimates may correspond to samples 
taken from a production line at various times during a shift and may be 
expected to be homogeneous if the process is in control but to have a 
high value if the process was out of control on one occasion. In situa- 
tions of this type what is needed is a test of the statistical significance 
of the amount by which the largest of the variance estimates exceeds 
the others. Cochran has developed such a test and has provided a small 
table of 5 percent significance levels to facilitate its use.* 

Cochran’s test for the statistical significance of the largest of a set of 
variance estimates is described and its use illustrated in Sec. 3. Table 
15.1, which gives 5 percent levels of the test, is an extension of Cochran's 
tabic. Table 15.2 gives 1 percent levels, which were not tabulated by 
Cochran. In view of the approximations used in their computation, 
many of the entries in these tables are not accurate to 4 decimal places, 
as tabulated. Their accuracy is believed to be sufficient for most prac- 
tical purposes, at least until more accurate values are available. Foj’ 
discussion of the methods of computation see Sec. 4. 


2. BARTLETT’S TEST 

Let sf, si, si be k variance estimates distributed independently 

as for ni, ns, degrees of freedom, respectively, and s* be 

the pooled variance of the k samples 


where 


,2 = 


n = Sni 


Bartlett’s test involves computing 


B ^ log« s® — ^ Oi log, 

2.30259/ , , V . A 

= p 1 » logic ^ — y logio j 


( 1 ) 

( 2 ) 

( 3 ) 


* Cochran, “Largest of a Set of Estimated >'ariances. 
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where 


C = 1 + 


yi_i. 

/-iUi n 
3(A: - 1) 


(-i) 


Then even for quite small values of the nf, say, 5 or more, B has approxi- 
mately the X* distribution with A: — 1 degrees of freedom. Since C > 1, 
it need not be calculated if for C = 1 the value of B is not significant.* 


S. COCHRAN’S TEST 

3.1. Tables 

Let sj, s|, . . . , be A: variance estimates distributed independently 
as x^o'V^ ^ degrees of freedom each, and let 

largest 5* /v\ 

« = + j, (S) 

be the ratio of the largest s* to their total. Table 15.1 gives values 
of ^ to 4 decimals that are exceeded with probability P, where 
0.04875 < P < 0.05000, for n = 1 to 10, 16, 36, 144, and fc = 2 to 10, 
12, 15, 20, 24, 30, 40, 60, 120, ». Tabic 15.2 gives values of ^ to 4 
decimals that are exceeded with probability P, where 0.00995 < P 
< 0.01000, for the same values of k and n. These two tables thus show 
the 5 percent and 1 percent levels of g. They are exact levels (to 4-dcci- 
mal accuracy) whenever they exceed 0.5000 and in many other instances 
also. For example, a calculation oi Cochran’s implies that the entries 
in Table 15.1 for n < 10 and A: < 10 are exact 5 percent levels to 4-place 
accuracy. Presumably the entries of Table 15.2 for n < 10 and A: < 10 
are likewise exact 1 percent levels to 4-place accuracy. Values of n and 
k exceeding 10 were selected for accuracy in interpolation. Thus w-wise 
interpolation should be carried out in terms of 12/\/n; A:-wise interpola- 
tion, in terms of 120/A: or 60/A:. 

3.2. Example 

The following are the squares of sample standard deviations obtained 
from 20 sets of six strength tests of cement mortar, each set being obtained 
from a different mixing of the same cement mortar under similar condi- 

* Since this chapter went to press, Thompson and Merrington have provided 
"Tables for Testing the Homogeneity of a Set of Estimated Variances.” Writing 
(3) above as i? = M /C, they have tabled maximum and minimum values of the true 
5 percent and 1 percent significance levels of M for I; =s 3 to 15 and for 

cj = 3{fc - 1)(C. - 1) 

from 0 to 5 by steps of 0.5,' 5 to 10 by steps of 1; 12; and 14. 
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tions.* Are these 20 squared standard deviations homogeneous? In 


Sample Number 

1 

2 

3 

4 

5 

6 

7 

8 

9 1 

10 

(S.D.)» 

271 

389 

617 

107 

1052 

340 

383 

508 

1 

511 

438 

Sample dumber 

■11 

12 

13 

14 

15 

16 

17 

18 

19 


(S.D.)» ^ 


209 

936 

281 

346 

i 

383 

492 

512 

462 

349 


particular, is the standard deviation computed from the fifth sample 
"out of line"? 

In this case n = 5, fc = 20, and g = 1,052/8,860 = 0.1187, which is 
less than the corresponding 5 percent leVel (0.1735) given in Table 15.1. 
The anomalous value of the standard deviation from the fifth sample may, 
therefore, be attributed to chance, and the 20 sets of strength tests may 
be regarded aa homogeneojia with respect-to variability of the strength 
determinations. 

The squared standard deviations given above correspond to the 
definition 

6 

2 

(Sample standard deviation)* « — — ^ (6) 

A 

where i »= sample average “ ^ ^ ^^e Xi (f = 1, 2, ■ ■ • ,6) being 

»- 1 

the 6 individual strength determinations of the sample concerned, in 
pounds per square inch. Consequently, each value is ^ of the cor- 
responding variance estimate «*, defined by 

6 

X 

— a) 

However, the factor ^ is common to the numerator and denominator 
of g, so need not be taken into account explicitly. 

4. COMPUTATION OF TABLES 

Cochran has shownf that if sf, s|, . . . , sj are variance estimates 
distributed independently as x^a^fn for n degrees of freedom, and if 

= .-r+TFrrrrqrTi (^ = i, 2, • ■ ■ ,*=) (8) 

• Davies and Pearson, "Estimating from Samples," Table IV, p. 92; a descrip- 
tion of the tests appears on p. 77. 

t Cochran's r and n correspond to our n and k, respectively. 
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Then, for a given pair of values of k and n, the probability P that g exceeds the corresponding tabular entry satisfies the inequality 
0.04875 < P < 0.05000. For further details regarding accuracy of entries, see Sec. 3 of this chapter. 




table 15.2 

Upper 1 Percent Levels oe the Ratio of the Largest to the Som of k Independent Estimates op Variance, Each of Which 

Is Based on n Degrees of Freedom 


Table 15.2 


SIGNIFICANCE OF LARGEST VARIANCE 


391 


9 

O «Q 
OCOO 
O M 'O 

O h* 05 
O CO M 
O CO 

C') — — < 

0 — 0 
to — o 

04-0 
— — — 

eoc*o 

cocao 

00 ^iO 
OOO 

c-«o 
— CO to 
■TCOd 

ooo 

CO 

CO 00 

5S 


ood 

odd 

©oo 

ooo 

ooo 

ooo 

44 

to M lO 
OiMC^ 
CO T CO 

CO (NC5 

es — 

C^t-OCO 

t-oeoo 

— or* 

— OO 

C5 000 
to — fO 

ooo 

V Cl 
d — 

©o 


O O O 

o o o 

ooo 

ooo 

ooo 

ddo 

36 

h* CO b. 

1/3 iO 
O -1 O 
UO V 

— co-^ 
to toes 
eooo 

COC^SN 

^ (M — 
^-^C5 — 
CS 05 OO 
M — — 

lO«>i o 
co»oco 
toci o 
— o 

ooo CO 
— too 
00 O lO 

ooo 

V « 

eo — 
oo 


ddd 

ded 

ooo 

oo© 

ooo 

do© 

«o 

V ‘ooo 
05000 
n- CO 

V C5 10 
CsOIO 
Ot/5 — 
’JI CO CO 

r.. — C5 

C-INM 

<0 — TP 
C50^ 

oceco 

o»o 

^co 

— d 

CD V 

— Cl 

o o 


ddo 

o o o 

ooo 

ooo 

ooo 

ooo 

o 

05 CO CO 
CO ^ CO 
CO m 
OOCOU5 

r- v CO 

05 <?o — 
CO O CO 
^ TfO 

CCOV* 

”P »o o 

C4 C5^- 

CM — O 
COOtO 
M« — 

eo VCD 
00 tc — 
dOoo 

f— 

d 

CD O 

1/3 eo 
c o 


odd 

ooo 

ooo 

ooo 

©o© 

ddo 

o 

■T W 

r* r- o 

CO 05(^ 
09 CO lO 

^ 05 ^ 
lO 04 lO 
00 C4 t.- 

•vveo 

tfO C«CO 
I^CO — 
CV3 o oo 
cococ^ 

i3seir> 
^OcS 
— O *0 
Cl CM- 

oooco 

COOtO 
eo — 00 

p~l© 

VCD 

C5 — 

>o eo 
oo 


d d d 

ooo 

ooo 

ooo 

oo© 

odo 

00 

CO r- r* 
O C5 
50 — 50 
a U3 

coo — 
O TC5 
lO V CO 

CIOS' 
teci e> 
eoeoc-i 

ift^'ce 

coo 
to — ca 
Cl Cl — 

OPoCO 

©too 

zz:^ 

lO V 

Cl fO 

CD eo 
o© 


odd 

ooo 

OOO 

©oo 

ooo 

ddo 


8988 

7335 

6129 

«5CO*0 

UOOO 

U5 ^ ^ 

•^leoco 

CO CO CO 

Aci6ab 

®CI-*< 

ocir- 
Cl Cl — 

tDCIh- 

OCOlD 

VCIg 

00 r- 

CDtft 

CD ro 

oo 


odd 


= .2 


uo 

eo CO — 
c* CO o 
eo o c» 
or-o 

IDUOO 
C-C5tO 
00 — CD 
l/J Ift o* 

CDOCI 

db-W 

2S252 

V CO CO 

©CO 00 

05 © V 

©top 

CO 01 Cl 

05 VtO 

^toeo 

b- V — 

CD 05 
© d 
b- V 

oo 


ooo 

ooo 

^ooo 

ooo 

oo© 

ddo 

■ 

V 

to eo d 
o oor- 

05 to i6 

fooo 

CO to t-o 

t— — V 
evo..v 
cDdO 
wco 

vood 
eo cid 

Oto — 

©CDd 

d05 
poo 
o — 
oo 


ooo 

ooo 

ooo 

ooo 

ddo 

odo 

eo 

V — V 

33 eo — 
oo co 
33CCC- 

r- ootre 

lO t-T 00 
03 Cl CO 
CD CO iD 

05005 
O — CO 
<M00 — 
tf3 W 

— to 

C3 CO CD 

coeod 

to coco 
Cl — o 
dC3iO 
d — — 

© lO 

P QQ 

CD to 
— o 


OOO 

ooo 

ooo 

ooo 

ooo 

odo 

Cl 

o eo CO 
ta d V 
O V CO 
Cl 05 00 

lOOO V 
50 — V 
oOcicc 
r-b-CD 

db-oO 

U9d to 

— b-co 
CO to to 

— 05 b* 
lO CO © 
t-Od 

— VfO 

— d»o 
b- — — 
00—05 
dd — 

b- lei 
eo b» 
-/© 


OOO 

doo 

ooo 

doo 

ooo 

ooo 


Cieo CD 
C3 coc- 
os 03 CO 
05 05 05 

c: 90 CD 
I—d b- 
d 50 eo 

05 CO oO 

iO VtO 
Wb- 
03 to — 
b-t^b- 

00 b- 05 
d V© 
tob-b- 
CD to V 

b-do 
— eo V 
d CO 03 
VCOCI 

— lO 
to Cl 

— Cl 
d — 


ooo 

odo 

ooo 

ooo 

ooo 

ooo 

fir/ 

/ji 

Cl eo V 

U3CD b- 

00^0 

dtog 

voo 
deo V 



Then, for a given pair of values of k and n, the probability P that p exceeds the corresponding tabular entry satiahes the inequality 
0.00995 < P < 0.01000. For further details regarding accuracy of entries, see Sec. 3 of thU chapter. 
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then the probability that the largest of the ratios (8) exceeds g is given by 

^ , r. . . - 1) X. . ^ - l)(fc - 2) „ , , 

P(g) = kPiig) ~ 7^ -Piig) ~ 


31 


^{-D’^^PM (9) 


where Pi(g) is the probability that a specified one of the ratios exceeds g, 
Pi{g) the probability that a specified pair of the ratios both exceed g, and 
so on. Clearly 


Pkig) = 0 


when g > T 

K 


( 10 ) 


for it is certain that the largest ratio will be as great as \/k ; so the number 
of non-zero terms in (9) is the greatest integer less than 1/g. 

Cochran has shown that 


PM = 


1 n_ «(i; — I) , 

, (1 -x) 2 




\n n(k — 1)1 

U' 2 J 


0 < < 1 


( 11 ) 


and has given Pj(g) and Psig) in multiple integral form, from which the 
multiple integral form of P,(g), j = 4, 5, • • • , A:, is apparent. He has 
pointed out that, since PiCff) < (Pi(fi)I* for all values of n and k, the 
upper a levels of significance of g can be evaluated to a good first approxi- 
mation using only the first term of (9). Thus, if go is determined from 


Pi(0.) = I 

it follows from (9) that 


( 12 ) 

(13) 


that is, upper 5 percent levels of g determined from (12) will in all cases 
correspond to 0.04875 < P < 0.05000; and, in view of (10), will be exact 
when they exceed }4- Similarly, upper 1 percent levels determined 
from (12) will correspond to 0.00995 < P < 0.01000 and will be exact 
■when they exceed 
From (11) it follows that 

gain,k) = 1 -x« (14) 

k 


where 


P- 

fc 

P- + (* - 1) 
% 


k 



n n{k — 1) 
2’ 2 


] 


(15) 
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is the [ower a.(k [eve! of significance of the beta-function distribution, and 

[n, «(* — 1)1 (16) 

k k 

is the upper a/k level of significance of the F distribution. Hence 
go.(i(.(n,k) can be obtained from the tables of Thompson, or from those of 
Thompson and Merrington, for fc = 2, 5, and 10; and go.oi{n,k) can be 
obtained similarly for fc = 2. The values of given in Table 15.1 for 
A: = 2, 6, and 10, and of ^o.oi given in Table 15.2 for k — 2, were obtained 
in this manner. 

When n is an even integer, (11) can be reduced to a polynomial in g. 
Thus, when n = 2 

Pi(g) - (t - (17) 

and when n = 4 

Pi(y) = (1 - J7)^-=(l + 2ik - 1)6-] (18) 

as Cochran has pointed out. The corresponding polynomials for n *= 0, 
8, and 10 were determined. The values of go.oi and oi given in Tables 
15.1 and 15.2 for n = 2, 4, G, 8, and 10 were obtained with the aid of 
these polynomials. In all other cases the values of po.o$ and go.oi were 
evaluated from 0.05/A; and 0.01/A; levels of F, which, in turn, were deter- 
mined by means of a modification of a procedure due to Paulson. 

It is believed that as estimates of go.os and ^o.oi the entries of Tables 
15.1 and 15.2 are correct to within 1, or possibly 2, units in the fourth 
decimal place. The accuracy of the tabular entries as estimates of the 
true 5 percent and 1 percent levels of g is in general unknown, although 
it is known that the tabular values tend to exceed the true values. It is 
believed, however, that in all cases the tabular 5 percent levels correspond 
to 0.04875 < P < 0.05000 and the tabular 1 percent levels to 0.00995 
< /* < 0.01000. With this understanding, Tables 15.1 and 15.2 should 
be useful in practical work until more accurate tables become available. 
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CHAPTER 16 


INVERSE SINE TRANSFORMATION OF PROPORTIONS 


1. HISTORY OF THE TRANSFORMATION 
If successive samples of n items each are drawn independently at 
random from a very large (infinite) population in which a proportion. P 
of the items possess some definite attribute A, then the proportions 
Ph Pit P8> • • • of items possessing A in the successive samples will be 
distributed in such a manner that as the number of independent samples 
is increased without limit the average of the p’s ^^'ill tend to P and the 
mean of their squared deviations from P will tend to P(1 — P)/n. In 
the language of statistics this is expressed by saying that, if a sample of n 
items is drawn at random from an infinite population in which a propor- 
tion P of the items possess a definite attribute .4, and if the proportion of 
items possessing A in the sample is denoted by p, thep 


and 


or 


Expected value of p = E(p) = P 

Variance of p = V’(p) — — 


Standard deviation of p = <r, 


ETZ 

V W 


-P) 


( 1 ) 

(2) 

( 3 ) 


Equation (3) or equation (2), considered in conjunction with equa- 
tion (1), states that observed proportions p, based on successive inde- 
pendent random samples of size n, may be expected to be grouped more 
closely about the true proportion P when n is large than when n is small; 
for fixed sample size, their sampling variation about P will be greatest 
when P equals and' will decrease toward zero as either P or 1 — P 
approaches zero. This dependence of the sampling variation of an 
observed proportion p upon the true proportion that it estimates, P, is 
a source of inconvenience in certain kinds of theoretical w'ork and in some 
types of statistical analysis of research data. Basically, the incon- 
venience is a consequence of the fact that for purposes of statistical 
inference (for e.xample, estimation of parameters, tests of agreement 
between observation and hypothesis) the worth or “weight" of an indi- 
vidual observation (here, a single observed proportion p) is generally 
inversely proportional to its sampling variance. Accordingly, the for- 
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miilas of statistical theory and the calculations of statistical analysis are 
simpler, in general, when the observations involved are of equal weight, 
that is, of equal precision. 

Recognizing this fact, R. A. Fisher, in a paper on theoretical genetics 
published in 1922,* introduced the transformation cos ^ = 1 — 2p, 
where varies from 0 to as p varies from 0 to 1, and utilized the fact 
that, when <p is computed from large samples, tlie variance of (p is, for all 
practical purposes, independent of the true proportion P. 

Fisher employed this transformation to simplify the mathematical 
equations occurring in an application of statistical theory to a problem in 
genetics. In 1930 lie published another paper on this problcmf in 
which he considered the bias of the transformation in large samples 
and showed that his failure to make allowance for this bias in his earlier 
paper accounted for the discrepancy between one of the results therein 
and a solution to the same problem obtained in a different manner by 
Sewall Wright. Not until 193C were the possibilities of this transforma- 
tion in connection with statistical analysis of research data discussed in 
print, when three writers indicated advantages to be gained from its use 
in statistical analyses of data expressed in the form of observed propor- 
tions (or percentages of items counted). Ilartlctt.J on a suggestion from 
Yates, Fisher’s coworker at the Rothamsted Experimental Station, 
considered the use of a related transformation (sin- 6 ^ p, where B varies 
from 0 to t/ 2; see below) as a means of rendering proportions amenable 
to analysis-of-variance techniques, which assume equal precision of the 
observations involved. With the same objective, Bliss, | after some 
correspondence with Fisher, recommended the use of the angular trans- 
formation sin^ 0 = p in the statistical analysis of field-trial data expressed 
in percentages (that is, 100 times the proportion of items with a given 
attribute in a sample) and gave an extensive table of B (in degrees) for 
percentages (that is, lOOp) from 0.01 to 99.09. Zubin[| pointed out the 
advantages of using Fisher’s transformation as a means of simplifying 
the calculations involved in testing the statistical significance of a differ- 
ence between two observed proportions, his attention having been 
drawn to Fisher’s papers by Hotelling. Zubin, utilizing this transforma- 
tion, subsequently prepared nomographs 1[ by means of which the statis- 
tical significance of the difference between two observed proportions can 
be determined almost at a glance. These nomographs jointly are, in a 
sense, the ancestors of the nomograph presented in Chap. 7 above. 

* Fisher, “On the Dominance Ratio,” p. 326. (For full citations, see Sec. 5.1.) 

t Fisher, “The Distribution of Gene'Ratioa.” 

t Bartlett, “Square Root Transformation in Analysis of Variance," p. 73. 

§ Bliss, “The Analysis of Field Experimental Data Expressed in Percentages." 

II ZiTBiN, “Note on a Transformation Function for Proportions and Percentages." 

*1 Zubin, “Nomographs for Deter mining the Significance of the Difference.” 
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Since 1936 a great deal has been written on the transformation of 
proportions to angles, to facilitate or validate various forms of statistical 
analysis. A fairly complete bibliography is given at the end of this 
chapter; it includes references to tables that have been published to 
facilitate the angular transformations in current use. 

The remjlinder of this chapter is devoted to a discussion of the effec- 
tiveness of Fisher's transformation in small samples, especially the 
dependence on P of the expected value and the variance of ip. A simple 
adjustment, due to Bartlett,* is discussed, and a table (Table IC.i) of 
adjusted values provided to facilitate its use. Ivlore elaborate adjust- 
ments, determined by the data themselves in any given case, have been 
discussed by Cochran, f and tablcsf are available to facilitate their use. 
In the last section of this chapter the general method of determining 
transformations to stabilize variance is outlined, the angular transforma- 
tion of Fisher derived, and seveml other such transformations noted. A 
method of discovering Bartlett’s adjustment is noted, which may be use- 
ful in other situations. ♦ 


2, NATURE OF THE TRANSFORMATION 

Let p denote the proportion of items possessing some particular attri- 
bute in a sample of n items drawn independently at random from a very 
large (infinite) population of items in which a proportion P of the items 
possess the attribute in question. Under these circumstances the mean, 
variance, and standard deviation of p are functions of P, given by equa- 
tions (1), (2), and (3). Let ^ be an angle (in radians) determined by the 
transformation 


^ = 2 arcsin \/p = arccos (1 — 2p) 0<p<l 0 < ip < tr (1) 

the inverse of which is 


p = sin2 ~ = 


1 — cos <p 


0<P<1 0<<^<7r 


(5) 


Then, when the number of observations n upon which p is based is largo, 


where 


Expected value of v? = 

= <p{P) approximately 


<p{P) = 2 arcsin \/P 


( 6 ) 

(7) 


• Bartlett, “Some Examples of Statistical Methods," p. 168. 
t CoenBAN, “The Analysis of Variance When Experimental Errors Follow the 
Poisson or Binomial Laws,” pp. 342^. 

X Fisher and Yates, Stalislkal Tables. 
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and 

Variance oi tp = V{ip) = ^ approximately* (8) 

An elementary derivation of this transformation is given in Sec. 4. This 
is the form in which the transformation was introduced by Fisher in 1922; 
the transformation has been employed in this form by Zubin and, with 
certain, modifications, by the Slati»tical Research Group. f 

Other writers, following Bartlett and Bliss, have transformed p to an 
angle 6 equal to (p/2, whence V'(tf) = l/4n approximately for B in radians 
or 821/n approximately for Q in degrees. Thus, when B is expressed in 
radians, V(0) has, for a unde range of values of P, approximately the 
value of V(p) when P = This advantage, if such it is, is lost, how- 
ever, when B is expressed in degrees. 

TABLE 10.1 

Means and Variances of Various Functions of a Sample Proportion fob 
Selected Values of the Population Proportion When the Sample Size 

Is 10 


p 

•piP) 

E(p) 

40r(p) 

EW) 

10K(v=) 

Eive) 

lOVM 

0.0500 

0.4510 

0.0500 

i 0.1900 

0.2856 

1.2917 

0.4757 

0.4481 

0,1000 

0.6435 

0.1000 

0.3600 

0.5134 

1.C567 

! 0.6241 

0 . 7489 

0.1600 

1 0.7964 

0.1600 

0.6100 

0.7006 

1.0529 

0.7032 

0.9303 

0.2000 

! 0.9273 

0.2000 

0.6400 

0.8598 

1.5332 

0.8939 

1 ,0436 

0.3000 

1.1593 

0.3000 

0.8400 

1.1260 

1.2968 

1.1350 

1.1224 

0 6000 

1 1.6708 

0.5000 

1 1.0000 

1.6708 

1.1433 

1 1.6708 

1 . 1258 

0 . 7000 

1 , 9823 

0.7000 

0.8400 

2.0156 

1 .2968 

2.0066 

1 . 1224 

0.8000 

2.2143 

0,8000 

1 0.6400 

2.2818 

1.5332 

2.2477 

1 .0436 

0.8500 

2.3462 

0.8500 

0.5100 

2.4410 

1.6529 

2.3784 

0.0363 

0.9000 

2.4981 

0.9000 

! 0.3600 

2.6282 

1 ,6567 

2.5175 

0 . 7489 

0.9500 

2.6906 

0.9500 

0.1900 

2.8560 

1 ,2917 

2.6659 

0.4481 


Explanation 

Let P denote the proportion of items possessing a definite characteristic in an 
infinite population 

p denote the proportion of items possessing this characteristic in a sample of 
10 items drawn independently at random from the population 
Then v?Cp) “ 2 arcsui y/p = arcros (J — 2p), 0< P<1, 0<9<ir 
fsip) = v»(p) for 0 < p < 1, vs(0) = «>s(l) — V — vfl(O) 

and E( ) denotes average or expected value of the quantity within the parentheses 
V{ ) denotes variance of the quantity within the pai'euthescs. 


* If is measured in degrees 


3282.8 

n 


t Sequential Analysis, Sec. 3.6; also Chap. 7 of this volume. 












Sec. 3 


INVERSE SINE TRANSFORMATION OF PROPORTIONS 401 


3. EFFECTIVENESS OF THE TRANSFORMATION 
Apparently the only published investigation of the effectiveness of the 
inverse sine transformation in small samples is that of Bartlett* for the 
case of n = 10. His analysis shows that when n = 10, the variance of 
depends very markedly on the true proportion P. A year later, he 
remarkedf that a good correction is to replace p = 0 by p = l/4n, and 
p = lbyp = 1 — l/4n, although he gave no supporting evidence. 

Tables 16.1 to 16.3 show, for n = 10, 20, and 30, respectively, the 
values to 4 decimal places of E{p), 4/iV(p), <p{P), nV{(p), Eitpa), 

and nV(«ps) corresponding to P = 0.05 to 0.20 by steps of 0.05, 0.30, 
0.50, 0.70, and 0.80 to 0.95 by steps of 0.05, where tpa denotes the angular 
transformation (4) modified as suggested by Bartlett, that is, 

•Pb{p) ~ 2 arcsin — arccos (1 — 2p) 0<p<l 0<<ffs<Tr . . 

¥’b(0) = 2 arcsin -v/lT^n, ~ jt — ^«(0) 

TABLE 16.2 

Means and Variances or Various Functions op a Sample Proportion for 
Selected Values of the Population Proportion When the Sample Size 

Is 20 


p 

^(P) 1 

i'(p) 

8or(p) 1 

EW) 1 

207(9) 1 

EM 1 

20T'(9b) 

0,0500 

0,4510 

0.0500 

0.1900 

0.3541 

1.6315 

0.4344 

0.7247 

0.1000 

0.6435 

O.IOOO 

0.3000 

0.5866 

1.5458 

0.6139 

1,0138 

0.1500 

0.7954 

0.1500 

0.5100 

0.7602 

1.3240 

0,7688 

1.0974 

0.2000 

0.9273 

0,2000 

0.6400 

0.9035 

1.1810 

0.9001 

1.1051 

0.3000 

1.1593 

0,3000 

0.8400 

1 . 1469 

1.0858 

1.1471 

1.0784 

0.5000 

1.5708 

0 , 5000 

1.0000 

1.5708 

1.0562 

1 . 5798 

1.0561 

0.7000 

1.9823 

0.7000 

1 0.8400 

1.9947 

1.0858 

1.9945 

1.0784 

0.8000 

2.2143 

0.8000 

0.0400 

2.2381 

1.1810 

2.2355 

1.1051 

0.8500 

2.3462 

0.8500 

1 0.5100 

2.3814 

1.3240 

2.3728 

1.0974 

0.9000 

2.4981 

0.9000 

0.3600 

2.5550 

1 .5458 

2.5277 

1.0138 

0.9500 

2.6906 

0.9500 

' 0.1900 

1 

2.7875 

1.6315 

2.7072 

0.7247 


Explanation 

Let P denote the proportion of items possessing a definite characteristic in an 
infinite .population 

p denote the proportion of items possessing this characteristic in a sample of 
20 items drawn independently at random from the population 
Then <e{p) = 2 arcsin Vp = arccos (1 — 2p), 0<p<l, 

•fisip) = 'pi.v) for 0 < p < 1, <pa(0) = viHo), «>b( 1) = a- — ^b(0) 
and E{ ) denotes average or expected value of the quantity within the parentheses 
V( ) denotes variance of the quantity within the parentheses. 


* Bartlett, "Square Root Transformation in Analysis of Variance,” pp. 74-75. 
t Bartlett, “Some Examples of Statistical Methods,” p. 168. 
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The mean values and variances of- fp and <p8 were determined by direct 
calculation.* 

If the inverse sine transformation completely stabilized variance in 
small samples, then nV{ip) would be unity in all cases, or at least would 
be constant for a given value of n. That this is not the case is clear 
from Tables 10.1 to 16.3. Evidently, nV{<pB) is somewhat less variable 
than nV{<p) over the range of values of P considered. The nature of 
the dependence of nV(sp) and nV(<pB) on P is depleted graphically in 
Figs. IG.l to 1C. 3, for n = 10, 20, and 30, respectively. For purposes of 
comparison 4nV(p) has been plotted also. The following conclusions 
may be drawn: 

(1) For n > 10 and 0.05 < P < 0.95, nV{>p) and nF(^s) are less 
variable than 4nV(p). 


TABLE 16.3 

Means and Variances of Various Functions of a Sample Proportion fob 
Selected Values of the Population Propobtio.n When tiib Saaiplb Sme 

Is 30 


p 


E{p) 

i2or(p) 

Eip) 

ZOVW) 

E(ifB) 

30V(vb) 

0.0500 

0.4510 

0,0500 

0.1900 

0.3885 

1.6443 

0.4278 

0 . 8985 

0 1000 

0.6435 

0 . 1000 

0.3600 

0.6119 

1.3359 

0.6197 

1,0921 

0,1600 

0.7054 

0.1500 

0.5100 

0.7757 

1.1560 

0.7771 

1.0987 

0,2000 

0.0273 

0.2000 

0.6400 

0.9134 

1.0885 

0.9136 

1.0773 

0,3000 

1.1503 

0.3000 

0.8400 

1.1516 

1.0484 

1.1516 

1.0481 

0.5000 

i , 5708 

0.5000 

1.0000 

1.570S 

I .0358 

1.5708 

1.0358 

0.7000 

1 , 0823 

0.7000 

0.8400 

1.9900 

1.0484 

1.0900 

1.0461 

0.8000 

2.2143 

0.8000 

0.6400 

2.2282 

1.0885 

2.2280 

1,0773 

0.8500 

2,3462 

0.8500 

0.5100 

2.3659 

1.1560 

2.3645 

1.0987 

0.9000 

2.4982 

0,9000 

0.3600 

2.5297 

1.3359 

2.5219 

1.0921 

0.9500 

2.6806 

0.9500 

0.1900 

2.7531 

1 . 6443 

2.7138 

0.8985 


Explanation 

Let P denote the proportion of items possessing a definite characteristic in an 
inEnite population 

p denote the proportion of items possessing this characteristic in a sample of 
30 items drawn independently at random from the population 
Then <f{p) « 2 arcsin \/p = arccos (1 — 2p), 0<p<l, 0<ip_<Tr 
<pb(p) = vip) for 0 < p < 1, v»a(0) = v{H 2 o). v»b(1) = t — ^s(O) 
and Ei 1 denotes average or expected value of the quantity within the parentheses 
V( ) denotes variance of the quantity within the parentheses. 


* Binomial probabilities to 7 decimals were obtained from Tables of Ike Incomplete 
Beta Function; arcsin values to 6 decimals were obtained by interpolation in Hayashi's 
Sieben-und mehrslellige Tafeln, the entries of this latter table being corrected in some 
cases in accordance with the list of corrections given in Mathematical Tables and Other 
Aids to Computation, Vol. 1, No. 6, p. 197. 
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(2) For > 20 and 0.05 < -P < 0.95, nV(<pB) is less variable than 
nVi<p). 

(3) For n > 10, and 0.075 < P < 0.925, nV{(pB) is less variable than 
nV{<p). 

Since it is quite apparent from the foregoing that the inverse sine 
transformation, especially with Bartlett's correction, is advantageous 


L«t P denote the proportion of items in aninfinita population that possess a given characierislic; 

p denote the proportion of items possessing the characteristic among the 10 Items drawn 
independently at random from the populotlon; 

®(p) ■ 2arcsin * arceos{f-2p); 

0b(p)-<»(p),O <p<1i «t>g(1)-7r-4)g{0); 

then V, = 4P11-P)-4 k10xV(p) 

V2= 10 V{<1») 

V,- 10 V(Og) 



Fia. 16.1. — Dependence of the variances of three functions of a sample proportion p on the 
population proportion P when the sample sisc Is 10. 


from the viewpoint of variance stabilization, its effectiveness in this 
regard increasing rapidly as the sample size n is increased, the question 
arises whether estimates of P obtained by transforming back to propor- 
tions after averaging in angular units will be biased. A comparison 
of the values of ^(P), E{v)t E{^b) shown in Tables 16.1 to 16.3 
reveals that E(ip) and Bitpa) generally are less than ip(P) when P < 
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greater than <p{P) when P > and the three are equal when P = 
Furthermore, for all values of n and P considered in these tables, Piips) 
is the closer to From Tables 16.1 to 10.3 it is seen that, when 

0.05 < F < 0.95, the bias ~ ^{P) is less than 15 per cent of the 

Let P denote the proportion of items in on infinite population ihot possess a given characteristic; 

p denote the proportion of Items possessing the ctwiracterlsttc among the 20 Items drown 
independently at random from the population; 

Olp) ■ 2 arcsin ^ ~ Qrccos{1-2p); 

felpl-'KpL 0 < p< 1; Ct>g(0)- <l>{1/80); <l>^( 1 ) = 7r- ©^(0); 
then V, -4P(1-P)-4x 20x Vip) 

Vg-aO V(d>) 

Vj-ZO V(4 )b) 



population proportion 1’ when tho sample hibc is 20. 

standard deviation of tpn when n > 10 and thus is of negligible magnitude 
for most practical purposes. Thus Bartlett’s correction, in addition to 
its advantage from the viewpoint of stabilizing variance, tends to reduce 
to negligible magnitudes the biases of estimates of P obtained by recon- 
verting averages expressed in angular units to estimated mean propor- 
tions with the aid of equation (5). 

* The values of for P ~ 0.05 and P = 0.95 when » = 10 are exceptions. 

Such exceptions can be expected to occur with ipu in those instances in which the p = 0 
or ;d = I class has a large probaluiity of occurrence, that is, when P is close to 0 or I 
and n is small. 
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Values of <pb{0) and expressed in radians, have been tabulated in 
Table 16.4 for sample sizes from 10 to 60, in order to facilitate the use 
of Bartlett’s correction. The values of ^^(O) and ^*(1) given in Table 
16.4 may be used in conjunction with Zubin’s “Table for Transforming 
Proportions to T values”* without modification; they should be divided 

Let P denotB the proportion of items in an infinite population that possess a given characteristic; 

p denote the proportion of items possessing the characteristic among the 30 Items drawn 
independently at random from the population; 

0(p ) “ 2arcsln Vp » orccosi1-2p): 

0<p<l; iPgfO)- «>f1/l20); 
then V,'-4P(1-P)-4« 30*V(p) 

Vj-30 
-30 Vf®,) 


V 



P 

Fig. ie.3. — Dependence of the variances of three functions of a sample proportion p on 
the population proportion P when the sample size ia 30. 


by 2 before being used in conjunction with Bartlett’s tablet; they should 
be multiplied by 28.G4789 before being used in conjunction with the 
tables of Bliss, Fisher and Tates, and Snedecor. 

A previous publication of the Statistical Research Group gives a 
tablet of the transformation 


• Zubin, "Note on a Transformation,” Table 4, p. 220. 
t Bartlett, "Subsampling for Attributes," Table II, p. 132. 
t Sequential Analysis, Table 3.64, p. 3.57. 
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y(s,n) = 2 arcsin -y/s/n 0 < 8 <'n, 0 < y < r 

y{Q,n) = \/'2jn for s = 0 (10) 

y(n,n) — ir — y/^Jn for 8 = n 

for values of n from 10 to 50. Comparison of the foregoing with equation 
(9) above reveals that y(«) = ^b(p) with p = s/n for 0 < s < w; 
■y(0) = \/2(Pb(0) approximately and y(n) = r — >/2(f?B(0) approxi- 
mately. Since the publication of this table of the y transformation, 
it has been found that Bartlett’s adjustments, ^s(O) and ^b(I), are 
slightly more effective for stabilising variance, especially when P is 


TABLE 16.4 

OF ^ND ps(i) FOR SAAfPLE.S OP 10 TO 50 ItEMS TOGETHER WITH VALUES 

OF THE Variance op When P = 0 5 


Sample 
size, n 

radians 

<pb{V), 

ra’dians 

To.8(»>e), 

radians* 

Sample 
size, n 

v’fl(O), 

radians 

^pbCI). 

radians 

radians* 


0,3176 


0.1126 

30 

0.1828 

2.9588 

0.0345 

11 

0.3027 

2.8389 

0.1011 

31 

0.1798 

2.0617 

0,0334 

12 

0.2897 

2.8519 

0.0918 

32 

0.1770 

2,9646 

0 0323 

13 

0.2782 

2.8633 

0.0840 

33 

0.1743 

2.9673 

0 0313 

U 

0.2681 

2.8735 

0.0775 

34 

0.1717 

2 9699 

0.0303 

IS 

0.2580 

2.8827 

0 0719 

36 

0.IC92 

2 9724 

0 0294 

16 

0.2507 


0.0670 

36 

0.1669 

2,9747 

0.0286 

17 

0.2431 

2.8985 

0.0628 

37 

0.1646 

2.9770 

0.0278 

18 

0.2363 

2.9053 

0 0591 

38 

0.1624 

2.9792 

0.0270 

19 

0.2299 

2.9117 

0.0558 

39 

0.1603 

2.9813 

0.0263 

20 

0.2241 

2.0175 

0.0528 

40 

0.1683 

2.9833 

0,0257 

21 

0.2187 

2.9229 

O.OoOl 

41 

0 1563 

2,9853 

0.0250 

22 


2.9380 

0.0477 

42 

0.1545 

2.9871 

0.0244 

2S 

<3 flSlPy 

2.33Pr 

3.3433 

■43 

3. 4323 

2.3SS3 

3.(i2SS 

24 


2.9371 

0.0436 

44 

0.1509‘ 

2.9907 

0,0233 

25 


2.9413 

0.0417 

' 45 

0.1492 

2.9924 

0.0227 

26 

0.1964 

2.9452 

0 0401 

46 

0.1476 

2.9940 

0.0222 

27 

0.1927 

2.9488 

0.0385 

47 

0.1460 

2,9956 

0.0217 

28 

0.1893 


0 0371 

48 

0.1445 

2.9971 

0.0213 

29 


2.9556 

0.0358 

49 

0.1430 

2.9986 

0.0208 





50 

0,1415 

3.0001 

0.0204 


Explanation 

Let P denote the proportion of itema possessing a definite characteristic in an 
infinite population 

p denote the proportion of items possessing this characteristic in a sample 
of n items drawn iodependoitly at random from the population 
Then = 2 arcsin y /p = arccos (1 — 2p), 0<p<l, 0<<o<5r 

<^fl{0) = 2 arcsin y / 1 /in ; vb(1) *= » — Vb(0) 
and Vo.svv’b) denotes the variance of when P = 0.5. 

Note: Whenn > 50, vb(9) = \/l/4», <pBiP) =ir — and yo.iiv^B) = \/n 1/n’ 

are correct to within 1 unit in the fourth decimal place. 
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near 0.05 or 0.95, than the simpJer adjustments y{0,n) and y(n,n). 
It is recommended, therefore, that, when special accuracy is desired, 
the values of and v^bCI) given in Table 16.4 of the present chapter be 
used in place of the values of y(0,n) and y(n,n) shown in the table of the 
y transformation. 

From Figs. 16.1 to 16.3 it is clear that, for a fairly wide range of values 
of P about P = 0.5, the variance of tps, nV(^s) being plotted as Vg in 
these figures, is quite close to its value for P = 0.5, say T'o.sCiiPs), and 
that Fo,5(¥’fi) approaches 1/n as n increases. Indeed, from a considera- 
tion of these three cases (n = 10, 20, 30) it appears that 


1 0.974 3.08 

' ••(»’») - s + “ip- + iii- 




(U) 


Using this formula, values of T'‘o.6(^b) were computed for intermediate 
values of n, that is, for 10 < n < 20 and 20 < n < 30, and, in the 
absence of any other formula giving correct values for n = 10, 20, and 
30, this formula was used to compute values of Vo.6(^ij) for n from 31 
to 50. These values are tabulated, together with the known values for 
n = 10, 20, and 30, in Table 16.4 and provide, it is believed, a reasonably 
accurate picture of the convergence of V(^b) toward its theoretical value 
of 1/a. The values of T’’o.s(^b) given in Table 16.4 are slightly larger than 
the values of the variance of y given in the table of the y transformation 
referred to above, but for n > 25 the e.xcess is very slight, being roughly 
1 unit or less in the fourth decimal place. 

Fisher and Yates have suggested that, when special accuracy is 
desired, observed angles be replaced by adjusted angular values in much 
the same manner as observed probits are replaced by adjusted probits. 
They have given a table to facilitate such adjustments.* * * § The adjust- 
ments proposed by Fisher and Yates are functions of the actual propor- 
tions observed in a given instance and thus are of a wholly different type 
from Bartlett’s adjustment, which may be regarded as a convenient rule 
of thumb. The theoretical basis of the adjustments advocated by 
Fisher and Yates has been given in a recent paper by Cochran. f 

Cochran has given an excellent discussionj of the presentation of 
results of statistical analyses in which transformations of original data 
have been employed to facilitate their statistical analysis. Curtiss§ has 
provided a general mathematical theory of transformations of data to 
render their analysis more tractable. 


* Fisher and Yates, Statistical Tables, Table XIV. 

t Cochran, “The Analysis of Variance When Experimental Errors Follow the 
Poisson or Rinomial Laws,” p. 342. 

t Cochran, “Analysis of Replicated Experiments,” p. J 68 and p. 170. 

§ Curtiss, “On Trans/ormalions.” 
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In conclusion, it must be remembered that while in large samples the 
variance of a transformed proportion is independent of the true propor- 
tion for most practical purposes, the variance of the transformed value ^ 
is still proportional to 1/n, where n is the number of observations upon 
which the observed proportion is based. Consequently, if pi, Pi, ps, . . . 

are proportions based on different numbers of observations ?ii. ^ 2 , 7^3, . . . 
and if the n’s differ widely, then the variances of the corresponding angular 
values may be so unequal, because of the variation of the w’s, that the 
advantages of the transformation are lost almost entirely. Similarly, the 
advantages of the inverse sine transformation may be lost to a large extent 
when the data to be analyzed are subject to other forms of variability in 
addition to sampling variation so that the variance of an observed pro- 
portion p is given by P{1 — P)/n + <r«, where the first term represents 
the variation of simple sampling and the second term the extraneous 
variation. In a recent paper* Cochran has discussed the analysis of 
fractions or percentages based on different numbers of observations (a) 
when extraneous variation is absent and (6) when extraneous variation 
is present. 

4. TECHNICAL NOTES 

4.1. General Transformation to Stabilize Variance 

4.1.1. Basic Theorem. — The transformation of random variables to 
stabilize variance may be based upon the following theorem: 

Let 6, (di < 6 < ^ 2 ), be a parameter of a statistical universe (pop- 
ulation), and let T be an estimator of 0, < T < raCS)!, based on 

n observations from the universe such that 


Expected value of T s E(T) <= 9 

Variance of T ^ V(T) = E{T -BY = 
Third moment of T about 9 = pziT) s E{T — 0)® 


= 0 1 - j as n 


Fourth moment of T about 9 — fn{T) s E{T — 9)* 

- 0 ) 


as n 


( 12 ) 


* Cochran, “Analysis of Variance for Percentages Based on Unequal Numbers.” 
t By v’(n) « o(n*) as n — » » we mean that lim = 0. la particular, o(l) 

H — * 

means a function that tends to zero as /i — ► «» . 

By ^(n) = 0(7i‘) as n ^ oo we mean that < it • »* for n > Ua, where K 

is finite and does not depend upon n, and rio is some (large) value of n. In particular, 
0(1) means a function that is bounded as n . 

This notation is in agreement with that introduced by E. liandau m 1909 and is 
now well established. 
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If the function 

and its first iti’o derii'atii’es exist for a}J admissible values of T, except 
perhaps for a set of measure zero, and if the mean value of its second 
derivative and of the square of the second derivative are finite for 
di < Q < 62 and every value of n, that is, if 

Eir^^iT)] = 0 ( 1 ) 

and 

= 0(1) (14) 

as n — » 00 for 01 < 0 < 02 and ri(0) < T < T«(d), then 



The first of assumptions (12) implies that T is an unbiased estimator 
of 9. The three further assumptions are introduced for the purposes of 
the theorem and are not very restrictive. Indeed, assumptions (12) are 
generally satisfied -when T is some sort of average that has been adjusted 
so as to be an unbiased estimator of a population parameter of interest. 

4.1.2. Proof of Basic Theorem. — ^Let f{T) be a function of T such 
that its second derivative /'^*(7’) exists for ri(0) < T < T^id), except 
perhaps for a set of points of measure zero, where Ti(6) < T < Ti^O). 
is the adnitssible range of values of T, tha.th,P[2\(^) < T < T2(9}{&] = 1 . 
Since E(T) = 0 by assumption, it follows that $ lies in the admissible 
range of values for T. Hence f(T) may be expressed As follows, with 
the aid of Taylor's formula and Lagrange’s form of the remainder term: 

f(T) = m + ( 10 ) 

where f = 0 ^r(T — 0), 0 < < 1, and the notation is used to 

emphasize the fact that the value of { depends upon the value of T con- 
cerned, Ti(0) < T < T3(0). 

Taking the mathematical expectation of each side of equation (16), 
it is found that 

EU(T)] = m + ^ ■ E|/®(()1 , (17) 

= /(®) + 0 ( 1 ) as n — > 00 

by virtue of assumption (14) and the second of j^sumptions (12). This 
shows that these assumptions, together with those regarding the exist- 
ence and differentiability of f{T), are sufficient to ensure that, as n 
increases without limit, the expected value of the function /(T) converges 
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stochastically to f(d), the value of the function when T assumes its 
expected value. 

Subtracting the left and right sides of (17) from the left and right 
sides, respectively, of (16), squaring, and taking expected values, it is 
found that 

U[/(r)] = E\fiT) - (18) 

= ■ V(T) + 3E^[/^^>(01/Hr) g[/<^>(0]V4(r) 

■ E[r-\i)hsiT) 

■*" 1 

In view of the assumptions (12) and (14), this becomes 

VU{T)] = [/<»(5)2 • V{T) as ^ « (19) 

= [/*“(^)]* * ^ ^ (^) as a -* CO 

Consequently, for the function defined by equation (13), equation (19) 
reduces to equation (15). This completes the proof. 

Curtiss* has considered somewhat more fully the mathematical 
aspects of transformations of random variables to simplify their variances, 
and his paper should be consulted by persons interested in a compre- 
hensive mathematical treatment. 


4.2. Applications of the General Procedure 

4.2.1. Proportion of Items Possessing a Particular Attribute in a 
Sample. — ^Let $ = P, the proportion of items in an infinite population 
that possess a particular characteristic A, and let T — p, the proportion 
of items possessing A in a sample of n items drawn independently at 
random from the population. It is well known that 


Eip) 

V{p) 


= P 

_ P{1 - P) 

n 


(20) 


,3(p) . 


M4(p) = 


3P=(i - py- , P(i 


P)(l - GP + 6P2) 
n» 


« 

Clearly M3(p) and m4(p) are both o(l/n.) asw— > <», andff(P) = P(i — P). 
Consequently, if there is a transformation that will stabilize the variance, 
the theorem implies that it will be 

/(p) = f , — = 2 arcsin Vp + C = arccos (1 — 2p) + C (21) 

J Vp(l - p) 


* Curtiss, “On Transformation.s Used in the Analysis of Variance.’' 
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where C is an arbitrary constant, which may conveniently be taken as 0. 
This yields the transformation tp{p), defined in equation (4), ^(p) being 
expressed in radian measure. It is not difficult to show that the second 
derivative of <p{p) satisfies the requirements of the transformation 
theorem for 0 < P < 1, whence 


VMp)] ^ 

Ti» 




as n 


(22) 


4.2.2. Mean of a Sample from a Poisson Exponential Population. — 
Let B — n, the parameter (mean) of a Poisson exponential population, 
and let T ~ S:, the mean of a random sample of n independent observa- 
tions from this population. It is well known that 


E(x) = > 

rw = I 

i‘>w = m 

'.m-S + S 


Clearly and are both o(l/n) asn «? , and g(fi) = (i. Conse- 
quently, the theorem implies that, if there exists a transformation that 
will stabilize the variance, it will be 

m = j^ = 2Vi + C (24) 

It is convenient to take C = 0. Bartlett* chose to drop the 2 also 
and recommended the transformation y =» -\/i. The first and second 
derivatives of y with respect to x are 

, 1 -1 
2V* ^ '*(*)’* 

and 

approximately 

2 Vm 

P(y") = approximately 
[P(7j")]^ = approximately 
• Bartlett, "Square Root Transformation.” 


(25) 


( 26 ) 
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Hence, equation (18) above becomes for y = Vx 


+ 54!^= + s (;|i + 

‘in 32yiW-* 

Therefore, as n — > « for fixed ju 

and as ^ » eo for fixed n 


V(y) 



(27) 


(28) 

(29) 


Consequently, if either n or m is large, V(y) = l/4n, approximately. 

4.2.3. Estimate of the Variance of a Normal Population Based on n 
Degrees of Freedom. — Let 0 = a\ the variance of a normal population, 
and let T »= 5 *, an estimate of <r* such that is distributed as x® 

for n degrees of freedom. 11 is not difficult to show that 

^(s*) 

r(s*) 


= <r* 

= £ 1 ® 

n 

= 8^ (30) 

n* 

12(n + 4)<r» 


Clearly ns and nt ore oii/n) as « — ^ eo and y(<r-) = (o’*)*. Therefore, the 
theorem implies that, if a transformation that will stal)iUze the variance 
exists, it will be 

For convenience, we may take (7 = 0 and consider the transformation 
y = log* s® = 2.30259 logio s*. Since 

Eiy') = approximately 

<T' 

E(y'') = — ^ approximately (32) 

[E{y”)\" ~ ^ approximately 
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the type of reasoning employed in connection with the preceding example 
shows that 


rao6.o=? + «(y 


as It — * for fixed 


as <r* — » ao for fixed 


(33) 

(34) 


Consequently, V(log, $*) = 2/n, approximately, provided either n or cr^ 
is sufficiently large. 

4.2.4. Correlation Coefficient Computed from a Sample from a Normal 
Population. — Let 6 — p, the product moment coefficient of correlation 
in a bivariate normal population, and let T — r, a correlation coefficient 
computed from a sample of n observations drawn independently at 
random from the population. The mean, variance, and higher moments 
of r are exceedingly complicated functions of p and n, but when n is 
largo and |p| « 1, 


E(r) = p approximately 

(I — a2)2 

V’(r) * i appro.ximately 


M.(r) =<.(i) 

^.(r) 


as a — ^ <c 

as n — » CO 


(35) 


Consequently, the theorem suggests the use of the following trans 
formation to stabilize the variance: 




+ rT“r) 


dr 


ilog,|^^ + C (3(1) 


Taking C = 0, this yields 




i+_r 
1 — r 


= tanh"‘ r 


(37) 


the transformation of r introduced by R. A. Fisher. * 

4.3. A Method of Discovering Bartlett’s Adjustment 
Let the values of 

tp(p) = 2 arcsin Vp (38) 

* Fisher, "On the 'Probable Error’ of a Coefficient of Correlation Deduced from 
a Small Sample,” Metron, Vol. 1 (1921), pp. 1-32, 
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where 

(x =0, 1,2, ■ ■ - ,n) (39) 

be plotted on the arithmetic scale of arithmetic-probability paper against 
the cumulative probability 

r = 0 

plotted on the probability scale, for a particular value of n and a selected 
value of P. If n > 10 and 0.05 < P < 0.95, it will be found that the 
plotted points for 2 < x < n — 2 lie very nearly on a straight line, that 
the points for x = 1 and x = n — 1 depart slightly from the e.xtension 
of this line, but that the points for x = 0 and x = n lie far off the exten- 
sion of this line. If the values v>(0) = 0 and ¥>(1) * tt are replaced by 
scores <p(0) =* On and ^(1) = l)« such that the corresponding .plotted 
points fall on a gently curving extrapolation of the curve through the 
plotted points for 2 < x < n — 2, it will be found that 

a„ = 2 arcsin 

— a„ approximately 

The foregoing suggests that a better adjustment than Bartlett’s 
could be obtained by extending in both directions the line of best fit 
through the points for 2 < x < n — 2 and using this line to define the 
scores for x » 0, 1, n — 1, and n. This was tried and some improve- 
ment was noted, but for n > 10 and 0.05 < P < 0.95 the improvement 
did not appear to be worth the trouble. 

This procedure may be found useful for obtaining adjustments of the 
Bartlett type in connection with other transformations to stabilize variance. 

6. REFERENCES* 
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approximately 


(41) 
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CHAPTER 17 

ELEMENTS OF SEQUENTIAL ANALYSIS* 

1. INTRODUCTION 

1.1. Nature of Sequential Tests 

A sequential test of a statistical hypothesis consists of making a 
certain calculation after each observation (or group of observations) and 
deciding on the basis of this calculation whether (i) to accept the hypothe- 
sis under test, (2) to accept the alternative to that hypothesis, or (3) to 
suspend judgment pending the examination of more data. The criteria 
for these decisions are such that the hypothesis is accepted or rejected as 
soon as, but not before, the data are sufficient for doing so with prede- 
termined degrees of reliability. 

1.2. Advantages and Disadvantages 

Sequential is superior to nonsequential analysis whenever (1) the 
data become available serially and (2) the cost of the data (in terms of 
time, labor, material, and so forth) is more or less proportional to the 
amount of data. Nonsequential analysis is superior whenever (1) the 
amount of data is fi.xed or (2) the cost of the data is hrgely overhead, 
hence more or less independent of the amount of data. Superiority con- 
sists in minimiring a set of quantities {N,oc,0), where N is the number of 
observations, a is the risk (that is, the probability) of erroneously 
rejecting the hypothesLa under test, and 0 is the risk, af ecraunQualy 
accepting this hypothesis. Sequential and nonsequential tests differ in 
the constraints under which this set is minimized. Nonsequential tests 
treat N as fixed and are so designed that with either risk a or ^ fi.xed the 
other is minimized. Sequential tests treat the number of observations N 

* Sequential analysis was developed in the Statistical Research Group in 1943, 
the theory principally by A. Wald and the techniques of application by numerous 
members of the group, including Kenneth J. Arnold, H. A. Freeman, Milton Friedman, 
M. A. Girshick, Edward Paulson, A. Wald, and W. Allen Wallis. 

This chapter is an extension of a memorandum by the author of the chapter, 
“Sequential Tests of Statistical Significance,” which is cited as “SRG 180” in Appen- 
dix B of Sequential Analysis. A more extensive exposition of the theory than is given 
here will be found in Appendix B of Seqaenlial AncUynis, and a more extensive sum- 
mary of methods of application than is given here will be found in "Sequential Tests.” 
For a complete and rigorous account of the theory, see "Sequential Tests”; for a full 
account of methods of application and interpretation, including computational aids, 
see Sequential Analysis. (For fuU citations, see Sec. B.) 
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as a variable and are so designed that, for fixed risks a and the expected 
(that is, average) number of trials N required to reach a decision is 
minimized. If for a nonsequential test N is made large enough so that, 
with oc fixed, ^ will not exceed a predetermined amount, this value of N 
will exceed (frequently by as much as 100 percent) the N required, with 
a sequential test for the same a and /3. Thus, when is readily subject 
to variation, sequential tests arc superior; when N is not readily varied, 
nonsequential tests are supmor.* 

1.3. General Procedure 

The basic quantity computed after each observation in a sequen- 
tial test is known in statistical literature as the “likelihood ratio." 
The probability of obtaining the observations actually at hand is com- 
puted first on the assumption that the hypothesis under test (designated 
the “null hypothesis") is true, and second on the assumption that the 
alternative to this hypothesis (the “alternative hypothesis") is true. If 
these probabilities are designated by Pa and Pu respectively, the likeli- 
hood ratio is simply Pi/Po. In a seciuenlial test it is computed after each 
observation (or group of observations), each computation being based 
on all the observations available. If the likelihood ratio ever reaches a 
certain level A (A > I), the collection of data (experiment) halts and 
the alternative hypothesis is accepted. If the likelihood ratio ever falls 
to a certain level 1/5 (5 > 1), the experiment ceases and the null 
hypothesis is accepted. When the likelihood ratio is between A and 
\/B, the evidence is insufficient for either decision with the required 
reliability. The required reliability, that is, the a and ^ of the preceding 
paragraph, completely determines A and B; in fact, = (1 — 0)/a and 
^ = (i - «)/;?. 

Since in most cases tlsc successive observations are independent, the 
likelihood ratio for a set of observations is simply the likelihood ratio for 
the last observation multiplied by that for the set of preceding observa- 
tions. Consequently, using the logarithm of the likelihood ratio reduces 
the arithmetic to addition and subtraction. After each observation, 
simply add log Pi to and subtract log Pa from the algebraic sum of such 
quantities for all preceding observations. If this sum ever reaches 

a = log A = log ^ ^ ^ (1) 

accept the alternative hypothesis; if it ever falls to —b, where 

• A detailed discussion of the nonditions under which sequential analysis is 
advantageous and those under which it is disadvantageous is given in Statistical 
Research Group, Sampling Inspection, pp. 33-38 and 91-97. Although the discussion 
there is in terms of specific circumstances, its generalization is obvious, 
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6 = log B = log (2) 

accept the null hypothesis. Otherwise, continue the experiment. 

1.4. Simplifications 

The preceding paragraph is applicable whatever the null and alterna- 
tive hypotheses may be, provided only that all parameters of each 
hypothesis are uniquely specified. In particular problems, the procedure 
can usually be simplified by expressing log Pi and log Po directly in 
terms of the observations, then adjusting the termination levels to simplify 
the expression. This is illustrated below for throe common tests: (1) for 
the probability of success in a binomial distribution; (2) for the mean in 
a normal distribution; and (3) for the difference in probability of success 
between two binomial distributions. The arithmetic can be reduced in 
the first and third cases to mere counting and in the second case to simple 
addition. 


2. BINOMIAL DISTRIBUTION 
2.1. Algebraic Simplification of General Procedure 

’Suppose it is required to determine whether the proportion p of suc- 
cesses, from a certain type of operation that results in either success or 
failure, is po. The alternative against which this is to be tested is that 
p “ Pi (pi > po). The value of po may be the minimum acceptable 
proportion for the operation, it may be a value observed from long 
experience with similar operations, or it may have been deduced from 
theoretical reasoning. The value of pi may be the least excess over po 
worth detecting, the proportion expected on theoretical grounds, and so 
forth. Suppose that, after N operations, S successes have occurred. 
The probability of this happening (in the sequence actually observed) is 
pf(l — pi)^“^ under the alternative hypothesis and pf(l — 
under the null hypothesis. The likelihood ratio is therefore 

(piY r ci -Pi) ]^'-^ 

Vpo/ L(i “ po)J 

and its logarithm is 

S,og(|i) + (iV-B)l„g[(L^j] 

The hypothesis that p = po is to be rejected, and the hypothesis that 
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p = Pi accepted, if this is ever as great as a, that is, if S ever reaches 


r pi(i - po) i 
[pft(i - pi)J 


log 


This is simply a linear function of N with positive intercept. Similarly, 
the hypothesis that p = po is to be accepted if S is ever as small as 


~b + ATlogl 


Pi/ 

log 

W' 

9 

- Po) 

- Pl)j 



another (and parallel) linear function of N with negative intercept. 


(4) 


2.2. Graphical Procedure 


Thus, the simplest procedure is to prepare a chart with N on the 
horizontal and S on the vertical axis. On this chart the two parallel 
lines 5i and iSo are drawn. After each observation is obtained, the total 
number of successes observed is plotted against the total number' of 
observations made. If, for any N, S is as great as Sj, discontinue the 
experiment and accept the hypothesis that p = pi. If, for any N, S is 
as small as So, discontinue the experiment and accept the hypothesis 
that p = Po- When 5 is between 5o and 5i, no decision is possible with 
a risk as small as a or 0. A variation of this procedure is to plot the 
number of failures F { — N — S) on the horizontal axis instead of N, 
retaining 5 for the vertical scale. Then tlic two decision lines become, 
respectively, 


and 



(5) 



( 6 ) 


Caution: Be sure that the same logarithmic base is used for o and b 
as is used elsewhere in and Sz. 
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3. NORMAL DISTRIBUTION 


3.1. Algebraic SimpUfication of General Procedure 


Suppose the standard deviation of a normal (Gaussian) distribution 
is known to be a and that it is required to test the null hypothesis that the 
mean rn is mo against the alternative hypothesis that m = mi (mi > mo). 
If N observations, Xi, Z2, , Xji, are obtained, the probability of this 

sequence is 


(<r exp 


1 

2«r2 


.V 

(a:i — mo)“ 

1-1 


(7) 


under the null hypothesis and the same expression, except with mi 
replacing mo, under the alternative hypothesis. From these probabilities 
the natural logarithm of the likelihood ratio is found to be 



( 8 ) 


The hypothesis that m = mi is to be accepted if this is ever as great as a, 
that is, if Ix is ever as great as 


Ml = 


Off- 


mi — wio 




(9) 


Similarly, the hypothesis m = m# is to be accepted if -a: is ever as small 
as 


il/o = 


— Ixr* 

mi — Mo 


+ 


mi mo 
2 


N 


( 10 ) 


3.2. Graphical Procedure 

As in the case of the binomial, prepare a chart 'ttith N on the hori- 
zontal axis and on the vertical axis, and draw on it the tAvo parallel 
straight lines Mi and Mo, of which Mi has a positive and i1/o a negative 
intercept. As each observation is obtained, add it to the sum of all 
previous observations and plot the total against N. If the plotted point 
is ever as high as Mi, terminate the experiment and accept the hypothesis 
that m = mi. If it is ever as low as Mo, terminate the experiment and 
accept the hypothesis that m = mo. When it is between Mo and Mi, no 
decision can be reached without a risk of error exceeding a or /3. 

Caution: Be sure that a and h are natural logarithms. (Natural 
logarithms are 2.3 times the corresponding common logarithms.) 
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4. DOUBLE DICHOTOMIES 


4.1. Null and Alternative Hypotheses 

Data from two different operations, each of which results in either 
success or failure, constitute a double dichotomy. To determine sequen- 
tially whether the proportions of successes are the same for the two 
operations (which is logically identical with testing whether the two 
operations are represented in the same proportion among the successes 
as among the failures), set up the null hypothesis that the ratio of suc- 
cesses to failures is the same for the two operations, and the alternative 
hypothesis that the ratio of successes to failures is u (w > 1) times as 
great for the second operation as for the first. Thus, if p\ and p 2 are 
the proportions of successes for the two operations, the null hypothesis 

is that ^ = 1, which is equivalent to pi = vz. The alterna- 

pi/(l - pi) ’ ^ ft 

tive hypothesis is that = «, which is equivalent to the relation 

Pi = upi/[l + pi(u — 1)]. Then collect observations in pairs, each pair 
containing one observation for each operation. Those pairs in which both 
operations succeed or both fail are disregarded, since they throw no light 
on the question of which operation yields the higher proportion of suc- 
cesses. Only the residual pairs, in which one and only one operation 
results in a success, are considered in the remainder of this section; these 
residual pairs will hereafter be called successes' if the operation expected 
under the alternative hypothesis to be superior produces a success. 


4.2. Algebraic Simplification of General Procedure 

Under the null hypothesis, the proportion of such successes among the 
residual pairs will be }^. Under the alternative hypothesis, the propor- 
tion of such successes will be m/(1 + u). Thus, tho problem reduces 
to that of the binomial distribution discussed in Sec. 2. If 5 is the 
number of successes and if F is the number of failures from N residual 
pairs (5 + F — iV), the logarithm of the likelihood ratio may be 
written 


S log 


2u 

1 +w 


+ F log 


2 

1 + u 


( 11 ) 


The alternative hypothesis (that the second operation is superior) is 
to be accepted if this is ever as great as a; this will occur if, for any F, S 
is as much as 
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Sr 


a F log 


1 M 


log 


2u 


1 + u 


( 12 ) 


a linear function of F with positive intercept. Similarly, the null 
hypothesis (that the two operations are equally good) is to be accepted 
if the logarithm of the likelihood ratio is ever as small as —6, which will 
occur if, for any F, S is as small as 


So 


— 6 + F log. 


log 


2m 

1 + M 


(13) 


a linear function of F, parallel to but with negative intercept. 


4.3. Graphical Procedure 

Thus, the simplest procedure is to prepare a chart on which the hori- 
zontal axis represents F, the number of residual pairs in which a failure 
has occurred with the operation e.xpected under the alternative hypothe- 
sis to be superior, and the vertical axis represents S, the number of residual 
pairs in w'hich that operation has succeeded. Draw on this chart the 
two parallel straight lines jSo and Si. After each residual pair is observed . 
plot a point whose coordinates represent the total number of successes 
and failures among all residual pairs obtained so far. If, for any value 
of F, S is as great as 5i, halt the experiment and conclude that the second 
operation is superior. If, for any value of Fj S is as little as So, halt the 
experiment and conclude that the two operations are equally good. 
When 5 is between and Si, no conclusion can be reached without a 
risk of error in excess of a or 0. An alternative procedure is to let the 
horizontal scale represent the number of residual pairs -{- F), in 

which case the decision lines become, respectively, 


and 


= 


SL = 


a -h N log 


I -b M 


log u 


— 6 -b AT log 
log u 


1 “b u 


(14) 


(15) 


Caution: Be sure that the same logarithmic base is used for a and h 
as is used elsew'here in So and S\. 
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6. OTHER APPLICATIONS 

5.1. Simple Problems 

Obviously, the general procedure and the simplifications described 
in Secs. 1.3 and 1.4 can be applied to a wide range of problems. The 
application is straightforward whenever the problem is simple, in that a 
single parameter 0 is under investigation and the purpose of the analysis 
is to discriminate between a null hypothesis that this parameter lies 
below above some level do and an alternative hypothesis that it lies 
above below another level 0i, where 6i > 6o < 6oV Voi example, 
procedures for testing the mean of a Poisson distribution and for testing 
the standard deviation of a normal distribution are easily derived from 
the general procedure. More complicated problems can sometimes be 
reduced to a simple form for which the procedure is straightforward, as is 
illustrated by the case of double dichotomies. 

6.2. Complex Problems 

Sequential procedures have also been worked out successfully for 
certain more complicated problems. Important examples are (1) test- 
ing the null hypothesis that the mean of a normal distribution has a 
certain value mo against the two-sided alternative hypothesis that the 
mean is either greater than mi or less than 2mo — mi (m.i > mo) ; (2) testing 
the same null and alternative hypotheses as in Sec. 3, but with no infor- 
mation about the standard deviation other than that given by the sequen- 
tial sample (the sequential equivalent of Student’s test) ; (3) testing the 
standard deviation of a normal distribution, with no information about 
the mean other than that given by the sequential sample; (4) testing the 
fraction of a normal distribution exceeding a certain level, with no 
information about the mean or standard deviation other than that 
given by the sequential sample. 

6. OPERATING CHARACTERISTICS 

6.1. General 

Sequential tests are determined by four quantities, the values 
and 01 specified by the null and alternative hypotheses for the parameter 
being investigated and the values a and j3 of the two risks of error. For 
simple problems involving independent observations, for example, those 
described in Secs. 2, 3, and 4, the sequential-test procedure involves only 
three parameters, the slope s and the two intercepts —hi and hi of the 
two decision lines. Obviously, then, many combinations of &o, &i, a, and 
^ lead to the same sequential test. By finding these combinations, we 
can determine the probability that the test will lead to acceptance of 
the null hypothesis for any possible value of 0, not merely 0o and 0i. 
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The function (curve) giving the probability of acceptance L$ for every 
possible value of 6 is known as the operating-characteristic function 
(OC curve) of the test procedure; and 1 — Le is known as the power 
function. 

6.2. Five-point OC Curves 

Although the equations of these curves are known, it ordinarily 
BufficeB to find five easily determined points on them. Two points are 
known from the fact that "at the extreme values of 9, for example, at 
p = 0 and p = 1 in the case of the binomial distribution, the probabilities 
of acceptance are 1 and 0. Two more points are known from the fact 
that the test was obtained in such a way that at do and the probabilities 
of acceptance are I — a and 0. A fifth, and intermediate, point results 
from the fact that the probability of accepting the null hypothesis is 

h2 

hi + ht 

/ (which is H if « * &) when 6 is such that the expected value of each term 
in the cumulated sum is s, for example, when the parameter of a binomial 
distribution is p = s, when the mean of a normal distribution is m = s, 
or when the standard deviation of a normal distribution is a \/i“ 

7. AVERAGE NUMBER OF OBSERVATIONS 

7.1. General 

The average number of observations ^ necessary to reach a decision 
will depend upon the risks of error and upon the divergence between 
the null and alternative hypotheses. will be greater the smaller a, 
the smaller 0, or the smaller the divergence between the null and alterna- 
tive hypotheses. Furthermore, it will have one value, No, when the null 
hypothesis is true and another, Ni, when the alternative hypothesis is 
true; in general its value N$ will depend \ipon the true value 9 of the 
parameter being tested. The function (curve) giving the average 
number of observations Ne for every possible value of 6 is known as the 
average sample number function (ASN curve). Its equation may be 
written 

^ (1 -L.)a-L<,6 . 

where L 0 is the probability, when the true value of the parameter is &, 
that the test wll result in accepting the null hypothesis, and ie represents 
the average value of the logarithm of the likelihood ratio when the true 
value of the parameter is 6. In the case of the binomial distribution, 
for example, the likelihood ratio is either pi/po (when a success occurs), 
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or (1 — Pi)/(1 — Po) (when a failure occurs). If the true proportion of 
successes is p, 


= p log ^ + (1 — p) log 
P» 


= log 


1 - Pi 


1 — Po 


+ p log 


(^) 

r pi(i - po) 

[po(l - pi) 


(17) 


7.2. Five-point ASN Curves 

Five points on the ASN curve are readily obtainable from the five 
known points on the OC curve. Two points are obtained from the 
extreme values of d and the corresponding probabilities of acceptance, 
1 and 0. Two more points, corresponding with 6o and di, are obtained 
by taking Lt equal to 1 — a and |9, respectively. The fifth, intermediate, 
point is obtained by multiplying togetlicr hi and hz and dividing the 
product by the variance of a term in the cumulated sum when 6 is such 
that the expected value of each term is «; for e.xample, the divisor of 
kihi in testing the binomial proportion is s(l — «), in testing the mean 
of a Poisson distribution it is s, in testing the mean of a normal distribu- 
tion of known standard deviation <r it is <r^, in testing the standard 
deviation of a. normal distribution it 1828^. This fifth value, isusually 
(but not necessarily) near the ma.ximum' of the ASN curve. 

For a given value of 0, sampling fluctuations will cause to vary 
from one sequential analysis to another, using the same values of hi, hs, 
and 8. The distribution of N is skewed in such a way that most samples 
require fewer than observations; the variability is such that the 
sample size rarely exceeds For usual combinations of 0o, Bi, a, and 

0, the ASN curve falls off sharply from its peak and and are 
substantially less than N,; this is not necessarily the case, however, 
and in fact it is possible for the maximum of the ASN curve to occur 
outside the interval to tfi, although $ = s is always between do and di. 
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a', probability of erroneously rejecting hypothesis 
under test, 271, 282. 283. 419 
taken equal to 0.50, 283 

use in determining sequential test procedures, 
420, 421 

(5m alio Error, of the first kind) 
a: probability that lot of acceptable quality *rill 
be rejected, 16 
(St« alio Producer's risk) 
a: true intercept of linear regression equations. 
322 

estimation of, when cost of each measurement 
depends upon its magnitude, 322-328 
o-level of significance, 270, 278-279, 281 
Alternative hypothesis, in analysis of variance, 
311-313 

for which probability of error of second kind 
ia0. 61, 231, 260n., 2G3, 264, 271, 270, 313. 
380, 421, 423, 424 

in tests of means, 61, 377, 379-3SO. 386, 423 
of proportions (percentages), 260n., 263, 264, 
357-358, 421, 424 

of standard deviations (variances), 231, 270, 
271, 278, 281, 311-313, 387 
American Society lor Yesting Materials, 58n., 93 
American Standards Association, 58n., 03 
Amount of information, about dependence of 
one variable on another, 321 
maximizing, when cost of each measurement 
depends upon its magnitude, 319-328 


Amount of information, about a function in 
neighborhood of maximum, 366 
provided by factorial experiment, 366, 367, 
370. 371 

provided by sequential experiment, 368, 369. 
370. 371 

about population mean (yi), provided by probit 
data, 345. 346 
maximizing. 349—352 
provided by sample mean (x), 161 
provided by sample median, 161 
about population standard deviation (o), 
provided by probit data, 345, 346 
caMLvmvav'svg «(. 3^-352 
provided by sample mean deviation, 162, 1C3 
provided by sample standard deviation («), 
162, 22B 

about quality of lot, providnl by samiiling 
inspection, 156-158 
when inspection is by attributes, 7 
when inspection is by variables, 7 
(5 m also Amount of inspection) 

Amount of inspection. 14, 15, 17-21, 26-28, 
60-66. 81. 82. 85, 100-109 . 231, 233, 234, 
235-244 , 259. 260, 263, 204, 274, 275, 278, 
280. 282. 283, 311-314, 319-328. 331-338, 
358, 302ft., 380, 381. 419. 420. 427, 428 
with attributes plans, 14, 15. 26-28, 237-244, 
259. 260n.. 263, 204. 427, 428 
comparison of double, multiple, and se- 
quential sampling, 237-244 
figures showing, 249-243 
contrasted with variables plons. 20-28 
formula for determining, with sequential 
sampling. 427, 428 

foraiagle sampling, 259, 2C0n., 263, 264 
nomogram for determining, for single 
sampling, 260 
method of using, 269n. 
when severity of any one test cannot be 
controlled precisely, 331-338 
average. 14. 15. 26. 85, 233. 234, 235-244, 358, 
3G2n.. 419. 420, 427, 428 
for comparison of two proportions, by 
sequential sampling, 424, 427, 428 
with curtailed (truncated) sampling, se- 
quential, 362n. 
single, 14. 15 

for double diebotomies, by sequential 
sampUng. 424, 427, 428 
with double sampling, compared to multiple 
and sequential, 237-244 
figures showing, 240, 242 
with multiple sampling, compared to double 
and sequential, 237—244 
figures showing, 240, 242 
with sequential analysis, contrasted with 
non-sequential sampling, 20, 85, 23.S- 
244. 419. 420 

general formula for one-parameter testsT 
427 

with sequential attributes plans, 26, 235-244, 
427, 428 

when acceptance line is omitted, 358 
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Amount of inspection, nverogc, with of^ueniinl 
attributes plana, contrasted with 
double and multiple- sampling 
attributea plana, 237-244 
figures showing, 240, 242 
contrasted with aingle-aample attributea 
plane, 26 

formula for, 427, 428 

with sequential one-decision binomial teat. 
358. 427. 428 

with sequential one-sided binomial teat, 
formulae for, 427. 428 
figurea showing, 240, 242 
with sequential one-sided test for when m 
la unknown, formula fur, 233 
figures showing, 234 

with sequcntisl variables inspection plan 
for fraction defective, 85 
(iS<e alto ASN curve) 

when cost of each measurement depends upon 
its magnitude, 318-328 

in curtailed (truncated) inspection, 14, 15, 362n. 
when decisions are baaed on signs of differencea 
between eample means, formula for, 380 
determination of, nomogram for, 260 
procedures (or. 17-21, 27n.. 28n.. 64*60, 
81. 82, 231, 274, 275. 278. 280. 282, 283. 
311-314, 331-338, 302n.. 427. 428 
for analysia-of-variance teats, 311-314 
(or x'-tests of variance estimates, 231, 
274, 273, 278 

for eurtsiled (truncated) sequential aam* 
pling, 302n. 

for F'teste of variance estimatea. 280, 282, 
283. 206. 3U-3I4 

for one<decision sequential binomial test. 
3S8. 427, 426 

when seventy of any one teat cannot be 
controlled precisely, 331-338 
for standard deviation tests, 274. 275. 
278, 280, 282. 283 

for variables inspection plans for fraction 
defective. 17-21, 27 n., 2Sn., 64-66, 81-82 
differences in, attributes veisus variables 
inspection, 26-28 

with double, multiple, and sequential 
sampling, 237-244 
figures showing, 240-243 
sequential versus non-sequential sampliDg. 
26. 85, 237-244, 419. 420 
figures showing, 233, 240-243 
distribution uf, in repeated sequential sampling. 
428 

with double sampling, compared to multiple 
and sequential, 237-244 
figures showing, 240-243 
figures showing dependence on quality sub- 
mitted, 234, 240-243 
fixed in advance, adjustment of k, 19, 20 
formulas for, 17, 27n., 28a., 60-63, 231, 233. 
259. 260, 263-264, 278n-. 427, 428 
in attributes inspection, with sequential 
sampling, 427, 428 

with aingle aampUng, 259, 260, 263, 264 


Amount of inspection, formulas for, for binomial 
teat, one-si(le<l, with sequential sam- 
pling, 427, 428 

with single sampling, 259 , 260n., 263, 264 
when decisions are based on signs of differ- 
ences between sample means, 380 
for difference of means teat, single sample, 
when a is known, 61, 62 
when ff is unknown, 17, 27n., 28n., 60-66, 
81, 82 

for diff^ence of propoettona (percentages) 
test, sequential sampling, 424, 427, 428 
aingle sample, 250, 260, 263, 264 
incorrect formula for, 258 I 

for double-dichotomy homogeneity test. 259, 
2C0. 263, 264 

for fraction defective test based on variables, 
single sample, 17 

when fi ia known and a unknown, 27n., 
28a., 231, 278 b. 

when M is unknown and a known. 27n., 
28n., 62 

when It and g are both unknown, 17, 27n . 
38».. 60-63 

for genera] one-parameter tests, sequential 
Minpling, 427 
single sampling, Cl, C2 
(or mean test, single sample, with g known, 
27n., 28«.. 62 

with g unknown. 17, 27n., 28n., CO-66, 
81. 82 

for proportion test, with sequential aampling, 
427, 428 

with single sample, 259, 200n., 263, 264 
when range of samples of k determines lot 
quality, with sequential sampling, 283 
with single sample, 231, 278n. 
for setting tolerance limits, 101, 108, 109 
for standard deviation test, with sequential 
sampling, 233 

with aingle sample, 281, 278b. 
for variables inspection plans for fraction 
defective, with single sample, 17 
when /t is known snd g is unknown, 27n., 
28n., 231, 278b. 

when ft is unknown and v ia known, 27n., 
28n.. 62 

when and g are both unknown, 17, 27n., 
28n., 60-63 

imnimum acceptable, when severity of any 
one test cannot be controlled precisely, 
331-338 

minimum proposed, when data are coarsely 
grouped or rounded, 213, 214 
with multiple sampling, compared to double 
and sequential, 237-244 
figures showing, 240-243 
nomogram for determining, 260 
uses of, and procedures, 2C0 
normal, 45 
reduced, 45 

reduction in. by efficient utilisation of data, 
169-163 

by knowing ji or g. 27, 28 
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Amount of inspection, reduction in, by using 
double sampling, 237—244 
figures showing, 240, 242 
by using efficient formulas, 160-163 
by using multiple sampling, 237—244 
figures sLowing, 240, 242 
by using sequential sampling, 26-28. 85, 233. 
237-244, 369-371. 419. 420 
figures showing, 233, 240, 242 
by using variables in8)>ection, 26-28 
with sequential sampling, 26, 20n., 85, 233-244, 
302n., 419, 420, 427, 428 
when acceptance lino is omitted, 358, 3 SSq. 
in attributes inspection, 26,235-244,427,428 
contrasted with double and multiple 
sampling, 237-244 
figures showing, 240-243 
contrasted with single sampling, 26 
contrasted with non-sequential sampling, 
26-28, 85, 235-244, 419, 420 
with curtailed sampling, 362n. 
formula for, general one^parametcr tesla. 427 
one-sided btiiomial test, 427, 428 
Qu^sidci teat for a, when is unknown. 233 
jirocedures for determining, curtailed sam- 
pling, 362n. 
general, 427 

one-decision binomial teat, 358. 427, 428 
m variables inspection (or fraction defective. 
So 

for setting tolerance limits, 100-108 
with single sample, 14, 15, 17-21.26-28.60-66, 
81, 82, 85, 231,'239,.2G0'. 263, 264, 274. 275, 
278, 280, 282, 283. 311-314, 331-338, 386. 
381 

analysis-of -variance ti'sts, 311-314 
attiibutes plana, 14, IS, 20-28, 259, 200, 
203, 204 

contrasted with eeqiicnttul eaiupUng, 26. 
419. 420 

contrasted with variables plana for 
fraction defective, 26-28 
binomial teats, one-eided, 259, 26(l, 260n.. 
263, 264 

X*-tests of standard deviation (or variance^. 
231, 274, 275, 278 

contrasted with sequential sampling. 26, 85, 
419, 420 
curtailed, 14, 15 

fl'ben decisions are based on signs 6( differ- 
ences between sample means, 380 
/lifTerence of means test, wben v is Iinown, 
61, 62 

difference of proportions (or iiercentages) 
test, formula, 259, 260, 263, 264^ 
nomogram for, 260 

double-dichotomy homogeneity testa, 259, 
260. 263, 264 

Sot F-test9 cS standard deviatituis for 
variances), 280, 282, 283, 311-314 
general formula lor one-parameter tests, 61— 
62 

for mean test, cr known, 27, 28, 62 
a unknown, 17, 27n., 28n., 60-66, 81, 82 


Amount of inspection, with single sample, for 
proportion test, 259, 260n., 263, 264 
when range In samples of k determines lot 
quality, 231, 278n. 

for standard deviation tests, 231, 274, 275, 
278, 280, 282, 283 

for variables inspection plans tor fraction 
defective, 17-28, 60-68, 81, 82 
when ft is known and <t unknown, 27n., 
28n., 231, 274, 275, 278 
when li is unknown and a is known. 27, 28. 
62 

when fi and a are both unknown, 17—21, 
26-28, 60-66, 81, 82 
standard deviation of, 238, 241. 243 

computational methods for determining, 244 
figures showing, 241, 243 
isbles showing, for analyBis-of-variance teals. 
3l3n. 

tor attributes plans, 26 
for setting tolerance limits, 102-107 
for standard deviation tests, 272, 273, 276, 
277. 284-295, 298-309 

for vsriables inspection for fraetion defective, 
22-27, 65 

with truncated samplifig, sequentisl, 362n. 

single, 14, 15, 238 
variability of. 235-244 
computational methods for determining, 344 
figures showing, 241, 243 
nature of, in repeated sequential sampling, 428 
Analysis of consumption requirements, 47-49 
Analysis of esperimental error (see Analyeis of 
variance) 

Analyais of production possibilities, 46, 47 
Aualysis of variance, 297, 310-314, 385, 386 
algebraic expression for coefficient of between- 
group variance, S12 
for degrees of freedom in, 312 
for mean squares in, 312 
expected values of, 312 
for sums of squares in, 312 
of binomial data, 398, 407, 408 
components of random variation In, 297, 310, 31 1 
resolution by, 311-314 
components of systematic variallon, 3 10. 31 1 
components of variance, resnbiliun by, 31 1-3 14 
of iiercentagc data, 398, 407—408 
plAniiliig experimeota leading to, 297, 310-314 
akcletou, 313 

eyetemotio versus random variation in, 297, 
316-311 
table, 312 

teste of significance in, 312-314, 385, 386 
for components of variance, 312—314 
for differences among subgroup means, 38.5, 
386 

(See alto Standard deviation; Variance) 
AnguJsr di/Jew>re, between two binojnis] pr&b- 
abUilies. 262. 264 

between two ohnerveil proportions, 264 
Angular trnnsturmatlon, 257-259. 261-264, 33(i. 
395-416 

(aSee ofeo Inverse-sine transformation) 
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Animal experiini'iita, 311, 341, 342, 343ti., 352 
Appfied Mathetoftlica Panel, hi. vii, « 

Summary Technical Report of, vii 
Approximations, involved in formulae for vari- 
ables inspection for fraction defective, 21, 
64-66 

c/Tecta of, 21, 49, 50, 62-64 
table showing, 65 

use ol non-central t to avoid, 64-66 
AQI< (get Acceptable-quality level) 
arcsin i, reference to table of, 260n.,265, 402n.,416 
Arcsine transformation, 257—259, 261-2C4, 336 
395-116 

(See aho Inverae-aine tranaformaiion) 
Arithmetic mean, of sample measurements, 161 
as 'estimator of population (lot) moan, 12 , 161, 
162, 192, 106-198, 200. 203, 212, 213 
foiinuU for, 12, too. 101, 161, 192 

when measurements are crouped (or 
rounded), 196 
symbol for (i), 13, 161, 192 

when measurententa ace grouped or rounded 
(is). 196 

(Sm also Sample mean) 
Arithmetic-probability paper. 414 
Army, viii 

Arnold, Kenneth J., ix, x, xii, 6, 354, 419 
ASN (»M Average eample number) 

Assignable causes, 269 

that Introduce random components of varia- 
lien. 297, 310, 311 

aysLeinatic compoaents of variation. 3l0. 311 
Aeytnptctie expanelon. for confidence limits for 
population proportion, 336 
for percentage paints of (-distribution. 148 
for percentage points of 7-distribulion, 155 
for tolerance-limit factor K, lOJ 
Attiihutos, inspection by. 7-^, 14, 15. 26-28, 
229«., 237-244, 259. Q60. 263, 264, 331-338. 
353-362, 419-422, 427, 428 
advantages and disadvantages of, 7-9 
amount of inspection, 14, IS. 2A-28. 237-244, 
269, 200n., 2C3, 264, 427, 428 
compariaoD of double, multiple and eequea- 
tial sampling, 237-244 
figures showing, 246-243 
comparison of sequential and single sampling, 
26, 419, 420 

comparison iritfa vsrisblea inspection, 26-28 
formula for determining, with eequeniial 
sampling, 427, 428 

with single sample, 259, 260n., 263, 264 
uomogram for determining, with single 
sample, 260 

procedure for using, 260rt. 
when severity of any one tcel cannot be 
controlled precisely, 331-338 
(See aleo Amount of inspection) 
to avoid normality assumption, 8. 229a. 
as bonis for deriding wfaethpr to abandon or to 
complete an experiment, 355-362 
contrasted with inspection by vmiables, 7-9, 
26-28 


Altribulea, curtailment uf, 14, 15, 238 
with double sampliug, 237-244 

amount of inspection, average, 240, 242. 244 
variability of, 238, 241, 243, 244 
characteiizcd by relation of Rk to At, 237 
computational procedures for, references to. 
244 

contrasted with multiple and sequential 
sampling, 237-244 

formulas, for acceptance line, with sequential 
sampling, 422 

for amount of inspection, with sequential 
sampUnK, 427, 428 

with single sampling, 259, 26Lin., 263. 264 
for ASK curve, with sequential sampling, 
427, 428 

for five-point OC curve, for sequential 
aampUng, 427 

for OC curve, for single sampling, 2C0n., 
261-263 

for rejection line, with sequential sampling, 
422 

for rejection number (proportion), with 
single sample, 260n., 263, 204 
when inspection is costly, 9 
when inspection Is destructive, 9 
with multiple sampling. 237-244 
amount of inspection, average, 240, 242, 244 
variability of, 23S, 241, 243, 244 
characteriecri by relation of Ri to At, 237 
coinputsUonal procedures for. referencea to, 
244 

conlrasiad with double and sequential 
sampling, 237-244 

nomogram, for determining amount of inspeu- 
tiun and OC curvs for single sampling, 260 
procedure for using, 260n., 263 
OC curve, for sequential sampling, procedure 
for fiva-point, 427 

single sampling, formula for, 26nn,, 263, 2C4 
nomogram for. 2G0 r,, 263 
when range in aamplce of k determinea lot 
quality, 229n. 
reasons for use, 7-9 

selection of AQL in, discussion of, 45-47 
with sequential sampling, 26, 233-244, 357- 
362. 419, 420, 421, 422. 427, 426 
acceptance line, formula for, 422 
when acceptance line is fixed in advance, 
358-362 

OO curve, prooeilure for, 361, 362 
when acceptance line is omitted, 357, 358 
OC curve, formula lor, 358 
amount of insperlinn, average, 26, 2i0, 242, 
244, 419. 42Q, 427,498 
variability of, 238, 241, 243, 244 
as basis for deciding whether to abandon or 
to eomplete an experiment, 357-362 
characterized by relation of Rk to At, 237 
computational firorsil urea for curtailed (trun- 
cated) satupUng. references to, 244, 
3ein.. 362n. 
steps of. 361, 362 
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Attributes, with Bequeotial eampling, corttrasted 
with (loulile- and muHipie-sampling attii- 
hutea iasiiection, 237-244 
duntrabtcd with sequential variables iit8|>ec- 
tion, 26n., 83 

single^ampliag, attributes inspection, 26 
curtailed ftrurtcated), 361, 362 
OG curva, when acceptance line is fixed in 
advance, procedure for, 361, 362 
when acceptance line is omitted, formula 
for, 358 

general five-point, formulas for, 427 
when sampling is curtailed (truncated), 
steps in determining, 361, 362 
rejection line, formula for, 422 
when severity of any one leal cannot be con- 
trolled precisely, 331—338 
with single samiile, 14, 15, 26-28, 237, 23S, 
250, 260«., 203, 284 

acceptance criterion for, 200n., 203, 264 
amount of inspection for, 14. 15. 26-28 
contrasted with sequential-sampling at- 
tributes inspection, 2tV28 
contrasted with single-sample variables 
inspection, 26-28 
formula tor, 250. 260n., 2C3. 264 
nomogram for, 260 

procedure for usiag, 260n. 
cliaracterized by relation of ffs to At, 237 
contrasted with double, and multiple 
sampling, 237 

with sequential attributes inspection, 26 
witli single-sample variables inspection, 
26-28 

curtailed, 14, IS, 238 
UC curve, formula for, 26tln.. 263, 264 
nomograph for, 2C0n.. 263 
rejection criterion, 260n , 263, 264 
when tests are destructive, 9 
Authorship, ix 

Average (see Arithmetic mesa; Mean; Sample 
mean) 

Average error, 162 

(See alto Mean deviation) 

Average sample number (ASN, ^), 238. 420 
(See alto ASN curve; Sample sise, average) 
ASN curve, 233-234, 238, 240, 242, 244. 362. 427- 
428 

comparison of, lor double-, multiple-, and 
sequenlini-fiampling attributes plans. 237— 
244 

figures showing, 240, 242 
computation of, references to general methods 
of, 244. 362n. 

definition of, for general one-parameter testa, 427 
special cases. 233, 238 

for double-sampling attributes plans, figures 
showing, 240, 242 
figures showing, 234, 240, 242 
five point, for sequential un^pBrameter 
tests. 428 

formulas, for general one-parameter sequential 
test, 427 


ASN curve, formulas, for sequential one-sided 
binomial test, 427, 428 
with acceptance line omitted, 358 
for sequential one-aided test of o, 233 
maximum of, position of, 428 
for muluple-eampling attributes plans, figures 
ahowing, 240, 212 

for sequential attributes pluns, figures showing, 
240, 242 

formula for, 427, 428 

for sequential one-sided binomial test, figures 
ehowing, 240, 242 
formula for. 427, 428 

for sequential one-sided test of it, figure showing, 
234 

formula for, 233 

Average sample size (tee ASN curve; Sample size, 
average) 

B 

D: critical value of likelihood ratio, in sequential 
analysis. 420 

B: function appearing in formulae for sequential 
variables inspection, 84 

b: critical value of minus k( — X) in sequential 
analysis, 84, 421 

b: function of ff, Ka. and Kt that appears in 
formula for k when N is fixed, 19, 59, 61 

formulas for. 20, 5D^_61 

b: multiple of — i) in formula for 

standard deviation of e, 58 
formula for. 58 
reference to table of, 58n. 

5: ratio of stand ard deviat ion of s to 

— 3). in jiftTJJUi) saonplaa, 58 
Baines, A. II. J.. 281n., 207, 313, 314, 318 
Barlow’s tables. 34. 03 

Bartlett. M. S.. 183. 385, 386. 387, 393, 308, 399. 

4(10. 401, 40.3-407, 411, 413-41.5 
Dartlett’a adjustmenti of inverse-sine transforma- 
tion, 390 

heuristic derivation of. 413, 414 
table to facilitate, 406 

Bartlvtt’s teat of homogeneity of variance eati- 
matca, 183, 387, 388 

compared to F-test lor homogeneity of sample 
means, 386 

os “omnibus test,” 385, 386 
optimum propertiea of, 386 
eeparaUon into parts, assignable to different 
factors, 386 

tables to facilitate application of, reference to, 
388 b. 

Daten, W. D.. 193n., 218n., 222 
Bennett, RolUn F., ix 

fiz probability of erroneously accepting hypothesis 
under t4»t, 271, 419 

taken equal to 0.50, 20, 21, 271, 274. 282, 283, 
313, 314 ■ 

use in determining acquenlial test procedures, 
420, 421 

(5ee alto Error of the seciind kind) 
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0' probability that lot of unacceptable quality 
will be accepted, 16 

(Set also Consumer’s risk) 

8'- true slope of a linear regression line, 322 

estimation of, when cost of each moaBurement 
depends upon its magnitude, 322-328 
(SiT Pearson's measure of pkewness, 197, 198 
fli: Pearson’s measure of kurtosis, 197, 198 
Beta function, incomplete-, 392, 393 

percentage points of, reference to table of, 338, 
394 

use to determine confidence limits for popula- 
tion proportion, 333. 334 
Bias, of bombing errors, 137, 147, 149 

of mean deviation as e.s<iinalor of a, 169«. 
of p as estimator of P, S97, 410 
of ip{p) and •fiB(p) as estimators of ^(P), 403, 404 
tables showing, 400-402 
of a as estimator of 58, 162 

adjustment factor, formula for, 58 
tables of, reforonces* to, 58n. 
of 8^ ae eetimator of a’, 192. 199, 412 
when data are grouped or roiindcd, 199 
of sample mean as estimator of population 
mean, 58, 162, 197, 198 
when data are gioupcd or rounded. 197, 198, 
212, 213 

of sampio median as estimator of normal 
population mean, 162 

of sample proportion as estimator of population 
proportion, 397, 410 

when inverse-sine transformation is used, 
403, 404 

tables showing, 400-402 
of statistical tests, if Sheppard’s corrections are 
used. 199, 200, 203 
from time trends in data, 371, 372 
from use of inverse-sine transformation. 4U3, 
404 

tables showing, 400-402 
from use of Sheppard’s corrections, 199. 200. 203 
of f ns estimator of /«, 58, 162. 197, J98 

when data are grouped or rounded, 197, 198, 
212, 213 

of i + as estimator of >t + io, 58 
Bigelow, Julian H.. ix 
Binomial distribution, 250, 261, 421, 427 

ASN curve for sequential one-aided test of 
parameter of, figures showing, 240, 242 
formula for, 427, 428 

confidence limits for parameter of, 332-336 
belts giving eighty percent limits, 335 
ninety percent limits, 334 
ninety-five percent limits, 333 
ninety-nine percent limits, 332 
accuracy oi, 33&n. 
preparation of, 335n., 33Cn. 
sources of, 335n. 

determination of, from percentage points of 
incomplete beta function, 333. 334 
examples of, 334, 337 
by using inverse-sine transformation, 336 
by using non-central f-distribution, 76, 
77. 33671, 


Binomial disuibulioii, confidence limits for 
parameter of, formula for, for case of zero 
ocruticncea, 335 336 

relation of, to percentage points of incom- 
plete beta function, 333, 331 
design of cxpeiiinents, for emuparing param- 
eters of two, 258-263, 424, 427, 428 
fur estimating parameter of a single, 238, 
333-337 

for testing parameter of a single, 259, 260n,, 
261-264 

double dichotomies, analysis of, by means of, 
249-253, 255 
examples of, 251 

experiments for comparing parameters of two, 
analys'd of data from, 249-258, 424, 425 
approximate single-sample method, based 
on binomial test. 240, 250, 255 
based on xe< 253-255, 256, 257 
based on inverse-siuc transformation, 
257, 258, 263, 204 

based on normal deviates, 253-257, 263 
“exact” single-sample method for, 250-263 
by Fulcber-Ziibin Item Analyzer, 267, 268 
incorrect method fur, 256 
by sequential analysis, 424, 425 
by Zubm-Fulcher Item Analyzer, 257, 258 
design of, 258-265, 424 
inverse-sine transformation of data' from, 
257. 258, 263, 264, 807-408 
number of observations needed, with sequen- 
tial sampling, 424, 427, 428 
with singlu samples, 268-261, 264 
formula for, 258, 259, 264 
nomogram (or, 260 
operating characteristics of (OC), 201 
OC curve of, determination by formula, 262 
from nomogram, 263 
figure shov>ing, 262 
OC surface of, 261, 262 
planning of. 258—265, 424 
sequential, 424, 425 

experiments for estimating parameter of a 
single, analysis of data from, 332-330 
design of. 236. 333-337 

inverse-sine transformation applied to data 
from, 330 

number of observations needed, 333-337 
sequential, 238n. 

experiments for testing paranieters of a single, 
analysis of data from, 200n., 263. 264. 421, 
422 

ASN curves for double, multiple, and 
sequential sampling, 240, 242 
design of, 259. 2G0n., 261-264, 427, 428 
in-veree-aitie tiaiif.loiinal.ioii ol data from, 
260 b., 261-264. 397-408 
number of observations needed, with double 
sampling, 237—244 

figures showing, 240-243 
with multiple sampling, 237-244 
figuies showing, 240-243 
with sequential sampling, 26, 237-244, 
419, 420, 427, 428 
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Binomial distribution, experiments for testing 
parametCTs of a single, number of 
observations needed, with sequential 
sampling, figures showing, 240-243 
formula lor, 427, 428 
with single sampling, 14, 15, 26-28, 259, 
200w,, 203. 204 
examples of (Table 1.3), 26 
formula for, 259, 260n., 263, 204 
nomogram for, use of, 260n. 

OC curve of, approximate determination 
from formula, 260 n., 262 
from nomogram. 2GOn., 263 
exact determination of pmnts on, using 
confidence-belt charts, 336n. 
using percentage points of incomi>lete 
beta function, 334, S36n. 
planning of, 259, 2Gr)n.. 261-264, 427. 428 
sequential, 421, 422. 427, 428 
oue-decision test, 358 
formula for. examples, 251 
homogeneity of samples from two, testing, 
249-258, 424, 435 

(iSe« qIso Binomial distribution, experiroents 
for comparing parameters of two) 
inverse-sine transformation of data from. 

257, 358, 259-264, 330, 397-408 
mean of, 397, 410 

moments of, third and fourth about mean. 410 
nomogram, for iletermiuing sainjAe sizes, in 
teetiuK parameters of. 360 
normal approximation to, 263. 264 
number of observations needed, for comparing 
parameters of two. 258-261, 2r>4. 424, 
427, 428 

formula for, 288, 259, 264 
nomogram for, 260 

for estimating the parameter of a single, 
333-337 

for testing the parameter of a single, with 
double sampling, 237-244 
figures showing, 240-243 
with multiple aarapUng, 237-244 
figures showing, 240-243 
with sequential sampling, 26, 237-244. 
410, 420, 427, 428 
figures showing, 240-243 
formula for, 427, 428 

with single samiiling, 14, 15, 26-28, 259. 
2G0a , 263. 264 
examples of, 26 

formula for, 259, 260n., 263, 264 
nomogram for, use of, 200n. 

OC curves, of tests of parameter of, 262 
one-derision test of parameter of, 358 
planning experiments for comparing paramecera 
of two, 258-203, 424. 427. 428 
for estimating parameter of a single, 238, 
333-337 

for testing parameter of a single, 250, 260/t., 
261-204 

Poisson exponential approximation to, 426. 428 
sequential estimation of parameter of. reference 
to woi k oil, 238n, 


Binomial distribution, sequential test, for com- 
paring two, 424, 425 

for testing parameter of a single, 421, 422; 

427. 428 

one-decision teat, 358 

single sampling for comparison of two, 249-264 
for estimation <it parameter of, 332— 33f> 
for testing parameter of. 14, 15. 26-28, 259, 
2607?., 263, 264 

standard deviation of, 255, 256, 397 
variance of, 397, 410 
Binomial-probability paper, 4]4n. 

Biological assay, 341, 342, 352 
{See alia Sensitirity testa) 

Biological experimentation. 311 
Bishop, D. J., 386n., 393 
Bivariate distribution, normal, 146 

relation of Hotelling's generalized T to ex- 
ponent of, 114, 115 

Bliss, Cheater I., 342n., 343n., 350n., 353, 398, 
400, 40.5, 415 

Ftonibsiglits, air testing of, function of, 117 
multivariate quality control api’lied to, 111- 
184 

problems of. 116 

Bowker. Albert H , ix, xi, 96, lOln., 109 
Bieaking strength, 365 

{See olio Met.'iUurgicuI experimeEts) 

Breen. Nancy Biixcy, x 
Broad classes (<« Grouping) 
brown. Richard H., 343ii.. 352 
brown Univcisity, ix 
Bureau of the Census, ix. xi, xii, 336, 354 
Bureau of Ordnance. Navy. 352 
Bureau of Standards (see Mathematical Tables 
Projeei; National Bureau of Standards) 

C 

«»: ratio of expected value of root mean square of 
deviatiuRs from sample mean, to in notm&i 
samples, 58 

reference to tables of, 58n. 
relation to a, 5Sn. 

Calculating machinea. eompariaon of makes and 
luodcls, 34n. 

use of. to riupUfy computation of a, 33. 34 
Camp-hleidell inequality, 49n., 221 
Carver. If. C.. I94n.. 223 
Causes, assignable, 269 

that introduce eomponpnts of random varia- 
tion. 297. 310, 311 

that introduce coinpononta of systematic 
vaiiation, 310, 311 
chance. 297. 310. 311 
Cayley, Arthur, I9I. 222 
Central tendency, nieasures of, 0 
Chance causes, 297, 310. 311 

Characteristics, operating, of sampling-inspec- 
tion plana and statisticaL teats (see Operat- 
ing charactei istica , Operating-characteristic 
curves; Operating-characteristic surface) 
Charts, control (see Control charts) 
list of, XIV 
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Check list, of poseible causes of lack of control, in 
air tesling of bombsights, 140 
of steps for cslcubiting j(/, f«, «), 74. 75 
for calculating ((f, 4, «J, 75. “S 
for computing OC curve, for any curtailed 
(truncated) sequential inspection (lest) 
procedure, 361 

(or single-sampling variables inspection 
plan for fraction defective, 32, 33 
for determining k, given N, pi, and 1 — tr, 76 
given N, ps, and 8, 76 

for determining ff and k. given pi, pt, a, 
and 8. 61, 62 

for determining p, given N, tco, and *, 76, 77 
for ileterming uu, given N, pi, and «, 76 
(,See also Compututioi)) 
of general likelihood-ratio sequential teat, 
420, 421 

for oelection of bombsigbts for test, and 
arrangement of bombings, 11^122 
of sequential procedures for locating a maxi* 
mum, 3G7| 308 

x«: chi(x) corrected for continuity. 254 

calculation 'of, from observed proportioiia (per- 
centages), 230, 257 
from 2X2 table, 254, 235 
significance levob of, 255 
X* (chi>e4uared): a variable having the x*Hliatri- 
bution, 73, 91, 270 
addition theorem for, 153 
adjusted value of, 254 

calculation of, from proportions (percentages), 
256. 257 

from 2X2 table, 254. 253 
correction for continuity. 254 
signidcance levels of, 255 
small expected numbers, 253 
correction fur continuity, general procedure for. 
234n. 

distribution of, formula (or. 270 

percentage points of. 103-110, 3l5n. 

Comish-Fisher type expansion for, refer- 
ence to, 100 
relation of Ka to, 258n. 
relation to partial sum of roisson series, 109 
tables of, 315n. 

relation of F-dislribution to, 316 
of normal ilistribution to, 258n. 
of #*-diBtnbuiion to, 270, 315 
of 7'-distribulion to, 153 
formulas fnr, special, 254, 256. 257 
significance levels of, 103-110, 3I5a. 

Cormsh-Fislier type expansion for, reference 
to, 109 

relation to partial sum of Poisson series, 109 
tables of, 3l5n. 

test of homogeneity, of proportions (percent- 
ages), 256, 257 
of 2 X 2 table, 254, 255 
of variance estimates. 387. 383 
(See alto Uartlctt's test) 
use in planning and interpreting experiments 
for testing standard deviation (or vari- 
ance) estimates, 209-280 


Class interval (tee Grouping interval) 

Clopper, C. J., 335n , 338 

Cochran, William G., 254n.. 205, 387-389, 392, 
333. 399, 407, 408, 415 

Cochran's test, for aignificance of largest variance 
estimate, 383-394 

contrasted with Dartlett's test for homogeneity 
of variance estimates, 386. 387 
example, workeil, 388, 389 
eignifieauce levels of, tables of, 390, 391 
accuracy of, 388, 303 

comiMitation of, method employed. 389-393 
interpolation in, method of. 388 

Coefficient, correlation, 413 

regression, estimation of, when cost of eacli 
measurement depends upon its magnitude, 
322-328 

of line fitted to probit data, 343 
eotimalion of, 343, 344 
relation to p and r, 343 / 

of s. for setting tolerance limits (tee K) 

in variables inspection for fraction defective 
(see k) 

Columbia University, iii, ix-xi 
Committee on War Hesearch of. x 
Dirieion of H'ar Research of, vii 
Statistical lleseorch Group of, iii, vii-x, 6, 8, 20, 
26.34,42.52, 83. 85, 93, lOl, 108, 109, 143, 
134, 188, 231, 234, 237. 244, 257, 260, 335, 
358, 361, 362, 400, 405, 419, 420, 428 
Trustees of, vii 

Combination of observations, 42. 48, 113, 114, 167 

Combinations of grouping-interval widths and 
sample sises satisfactory for statistical tests, 
213, 214 

Combining estimates of m. 42, 43 
of a. 42. 43 

probabilitiee from statistical teats, 167, 184 
tests for. 50-53, 113-116 
effect of, on probability of acceptance, SO, 51 
into o single*' score,” 51, 113, 114 

based on generalised Student’s T, 114-116 
values of • or 42, 43 
values of t, 42, 43 

Comparison, of two binomial distributions, 
design of and analysis of data from experi- 
ments for. 247-205, 424, 425, 427, 428 
of two means, design of and analysis of data 
from experiments fnr, GI, G2 
of two percentages (or proportions), design of 
and analysis of data from experiments for, 
247-265. 424, 425, 427, 428 
of two standard deviations (or variances), 
design of and analysis of data from experi- 
ments for, 267-318 

Components of variance, 260, 207, 310-314 

Compounding probabilities from statistical tests, 

167 

Computation, of acceptance line, 232, 233, 356, 
357, 423, 425 

acceptance number, 200n., 2C3, 2S4, 422, 425 
acceptance region, boiiiiilariea of, 30-41, 62-50, 
67, 07-71. 232, 233, 422, 423. 425 
adjusted value of chi or chi-squared, 254, 255 
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Computation, adjustment constant, optimum, 41, 

54, 70,71 

analysis-of-variance table, 312 
angular difference between two binomial 
probabilitieB, 264 

between two observed proportions (or per- 
centages), 262 

ailtbinetie mean, 12, 100 , 102 
ASN curves (or, 233, 244, 3Q2n., 427, 42S 
Bartlett's adjustment, of inverse-aine trnn^ 
formation, 399 

Bartlett’s test, of homogeneity of variance esti- 
males, 387, 388 
bias of • as estimator of tr, 58 

of as estimator of e*. when date are 
grouped, 199 

of * + kg os estimator of /i 4- 1», 58 
binomial distribution, 251 

Xt, from obaervod proportions or percenteges, 
256, 257 

from 2X2 table, 254, 255 
eomponenta of variance, 310-314 
confidence lirnits, for p, when a is known. 197, 198 
when « is unknown, 99, 200-203, 213-215 
for parameter of binomial distribution, 
338-336 

for population mean, 99, 197, 198, 200-203, 
213-215 

for population proportion, 42. 43, 333-336 
for V or V*. 193-200. 200-203. 213-215 
control limits, for means. 147-149 
for r-8tailstiC8, 152, 153 
(or variances, 151 
SI/. (i>, i). 74, 75 

dosage^mortality curve, 342-344, 350, 352 
efficiency, of estimatorn of population param- 
etfn, J60-J63, 237fi. 

of inspection plans and stettslical teste, 
20-28, 85 

(See alio ASN curve) 

expected frequencies, in 2 X 2 table, 253. 254 
ill and Ai, 232, 233, 358, 357. 422. 423. 425 
K, approximate, 101, 108 
exact, 108, 109 
k, approximate, 17—19 
exact, 76-79, 81, 82 

Lp. 23-33, 50-52, 76, 77, 80. 358. 361. 427 
La,. 282-296, 316, 317 
Lfl, 231, 271-279, 315 
L<r, 232. 233 
Lt. 262, 263 
N, approximate, 17 
exact, 8l, 82 

N», 259-260, 260n., 263, 264 
JVm. 23n.. 62 

N.. 27n.. 28n.. 231, 274, 275. 278 
Ni. 17-21, 26-28. 60-06, 81, 82 
number of observations needed, for analysis-of- 
variance teste, 311-314 
for attributes plans, with sequentinl samp- 
ling, 427: 428 

with single sampling, 259, 260n., 263, 264 
when severity of any one test cannot be 
controlled precisely, 331—338 


Contputation, number of observations needed, 
for binomial test, one-sided, with sequen- 
tial sampling, 427, 428 
with single sampling, 259, 260n., 263, 264 
for X* teste of variance estimates, 231, 274, 
275. 278 

for curtailed (truncated) sequential sampling, 
362 r. 

when decisions are based on signs of differ- 
ences between sample means, 3S0 
for determining whether new process (prod- 
uct) is more (less) variable than stand- 
ard, 231, 274, 275, 278 
whether one process (product) is more 
variable than another, 280, 282, 283, 296 
for difference of means test, when a is known , 
with single sample, 61, 62 
when tr is unknown, 17, 27r,, 28n., 66-66. 
81. 82 

for difference of, proportions test, with 
sequential sampling. 424, 427. 428 
single ssmiile, 259, 260. 263. 264 
for double-dichotomy test, 259, 260, 263, 
264. 424. 427, 428 

for F-teste of variance estimates, 280, 282, 
233.311-314 ^ 

for fraction-defective test based on variables, 
single sainplc, 17 

when n is known, and s unknown, 27n., 
28n..23l.274.275, 27Sn. 
when ii is unknown, and c known, 27n , 
28 r.. 62 

when M and e are both unknown. 17-21, 
27 r.. 28n., 60-66, 81. 82 
for general ouo-parameter tests, sequential, 

427 

single sample, 61, 62 

for mean test, single sample, o known, 27n., 
28n., 62 

9 unknown, 17-31, 27n., 28n., 60-^6. 81, 82 
for one-decisioa sequential binomial test, 
358, 427, 428 

for propoition test, sequential sampling, 427, 

428 

unglc sample, 259, 260n., 263, 204 
when rango in samples of k determines lot 
quality, sequential sampling, 233 
ungle sample, 231, 274, 276, 276n. 
for setting tolerance liniiu, references to. 
100 , 110 

for ataixlard deviation tests, 231, 374, 275. 

278, 280. 282, 283, 296 
for variables inapeetion plans for fraction 
defective, 17-21, 27n., 28 r., 64-66, 81, 82 
OO curve, for analysis-of-varianee teste, 310- 
314 * 

for attrihutee plans, sequential sampling, 
426, 427 

single sampling, 2C0n., 362, 263 
for binomial test, one-decision sequential, 358 
one-sided sequential, 426, 427 
truncated, 361 

onesided single sample, 2C0n., 262, 263 
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Computation, OC curve, for ol vaiiance 

estimates, 231, 232, 271-279. SI.*) 
for comparison of two means, a known, 61, 62 
a unknown, 30, 59-63, 71-73. 76, 77. 80 
for comparison of two proportions or per- 
centages, bcquculial, 424, 42P 427 
single sample, 262, 2G3 
for comparison of two standard deviations 
or variances, single asmpiing, 282-296. 
316, 317 

when deeisiuna are based on signs of difTcr- 
encee between sample means, 378, 379 
for double-dichotomy test, 262, 263 
for F-tests of variance estimates, 282-296, 
316, 317 

for fraction-defective test, bused on variables, 
2&-33, 76. 77. 80 

for general one-parameter teats, sequential, 
426, 427 

single sample, 01, 63 
for mean test, a known, 61. 62 
for one-decision sequential binomial lest, 358 
for proportion lest, aequential sampling, 
420, 437 

single sample, 260n., 2C3-3C3 
when range in aaniplee of k determines lot 
quality, sequential, 233 
single sample, 231, 271-279, 315 
for standard deviation tssts, 331— 233, 371— 
279, 282-296. 3lo-C17 
for variables inepection plane for fraction 
deleetive, 28-33, 70. 77. 80 
p and <fB, 399, 401 
«(a,|J,ni,ntl, 283-290, 3l0, 317 
Rp, for one-d«ci8|ou sequential binomial test, 
358 

fi(ee,0,i9), 231, 271-279, 315 
tot s», 12, 33, 34, 162, 192 
signiOcance levels, of Cochran's test, 389-393 
of ^'-distribution, 155 
of T’-statiaiics, approximate, 155 
of (-distiibiiiiun, approximate, 148 
T (angular difference), 262 
T (Hotelling’s), 142, 154 
T-statistics, 131, 133, 133, 145 
((/,S,»), 75. 76 
tolerance limits, 97-109 

two-point estimate of p and a from probit 
data, 330 
Us, 76 

X, 12, 100, 192 

yardetlrks, for diPferericnH of means, 150 
for ratio of two variance estimates, 152 
for T'-statialics, 156 
Computer’s rule («e« Rounding rule) 

Coinric, L, J., 93 
Conditional piubability, 41, 251 
Confidence in conclusions, 98, 2C9 
Confidence belts, accuracy of, 335ri. 
for population proportion, 332-336 
eighty percent, 335 
ninety percent, 334 
ninety-five percent. 333 
ninety-nine percent, 332 


Confidence belts, preparation of. 335n.. 336n. 
sources of, 335n. 

Confidence coefficient (-r.r), 43, 98, 100, 108, 332, 
336 

definition of, 08 
interpretation of, 43 

Confidence interx-als, 42, 43, 09, lOfl, 332-336 
contrasted with statistical tolerance ranges, 
99, 100 

deiinilion of, 42 

deiMiiidence of width of, on confidence coeffi- 
cient, 43 

on sample siae, 99. 100 

for parameter of binomial distribution. 332-336 
for population proportion, based on attributes 
inspection, 332—330 
baaed on variables inspeclion, 42-45 
for procesa-average percent defective, based on 
attributes inspection, 332—336 
based on variables inapcclion, 42. 43 

(See afao Confidence belts; Confidence 
Limits) 

Confidence limits. 99, 100, 196-203, 332-336 
contrasted with statistical tolerance limits, 99, 
100 

effect of grouping (rounding) on, 192, 190-203, 
213-215' 

fur M. when a is known. 197, 198 

based on grouped (rounded) date, 107, 198 
when a is unknown, 00 

based on grouped (rounded) data, 200-203, 
213-215 

for parameter of binomial distribution, 332-336 
lielts giving, 332-335 {»ee Confidence belts) 
determination of, accurate, from percentage 
points of incomplete beta function, 
333. 334 

examples of. 834. 337 
approximate, by means of inverse-sine 
transformation, 336 

by means of non-central /-distribution, 
76. 77, 336n. 

formula for, accurate, for c-.^o uf aero occur- 
rences, 335 
approximate, 336 

relation of, to percentage points of incom- 
plete beta function, 333, 334 
for population mean, 99, 197, 198 
for population proportion, 332-336 
for population standard de^-ialion (or variance), 
based on rounded data, 198-200, 213—315 
(See aleo Confidence belts; Confidence inter- 
vals) 

Consumer's risk {<8), conventional value of (10 %), 
46 

definition of, 16, 228, 229 

effect of reduced or tightened inspection on, 45 
maxiraum of. with variables inspoclion plans 
for fraction defective, 16, 17 
splection of, factors to consider in, 45-49 
Consumption requirements, analysis of, 47—49 
Contingeucy tables, 2 X 2, 249-205, 424, 425 
(•«« Binomial distribution, experiments for 
comparing parameters of two) 
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Contracts, vii 

Control charts, applied to air teeting of bomb- 
aights, 122-142 

some novel features of, 110-147 
trouble shooting with aid of, 137-140 
Control limits, for mearta, 147-150 

allowance for aampling variation ol data in 
base period, 119, 147, 148 
for r-BtatisticB,' 152-155 
for variances, 151, 152 

(Be« al»o Quality control) 

Cornish-Fisher expansion, 109 
Correction, Bartlett's, 399 

heuristic derivation of, 413, 414 
table to facilitate, 400 

of ehi or chUsquared, for continuity, 254, 255, 
257 

general procedure for, 2.54n. 
factora; a, b, and ci, 58 

for grouping, Sheppard's, l0*-19O. 222-223 * 

not to be used in connection with confi* 
dence lunits or tests of eignificancc. 190, 
200. 203 

of inverae-aine transformation, 309, 405-407, 
413, 4U 
Vates’, 254, 255 
(iSee alio Adjustment) 

Correlation coefficient, mean of. approaimaie, 413 
transformation of. to stabilize variance. 413 
variance of, approiimale, 413 
s-transtormation of, 413 
Coat, of experiment, 2C9 
of measurements dependent upon their magni- 
tudes, 321, 322 

linear regression analysis when. 322-328 
Craig, Cecil C., 93, l04n., 195n.. lOOn., 222 
Critioal level of a normally distributed test func- 
tion, derivation of. 61, 62 
Crum, W. L., 146 r., 183 

Cumulative dUiributioii, estimating ti and « from 
data on, 339-352 

optimum design of experiments for, 345, 346, 
349-352 

Curtailment, of sequential teat, 301 

of single-sample inspection plan for fraction 
defective, baaed on attributes, 14, 238 
baaed on variables, 14 
(liirtiss, ,Tolin H., 407, 410, 415 
Curve fitting, when cost of eaeb measurement 
depends upon its magnitude, 321-328 
when data are observatioas on cumulative 
distribution, 342—353 
when data are probits, 342-352 
to data from sensitivity testa, 342-352 

D 

d; distance from target, 342 
Daniels, H. E., 297fl., 318 

Data, adj usted, in variables inspection for fraction 
defective, 36-41, 54, 69-71 
amount of (see Amount ol inspection; N; N, 
Sample size) 


Data, on attributes, 7 
bias of, 160, 371 

combination of, 42, 43, 113-116, 167 

correlated, 50-52. 113-116 

on cumulative distribution. 339-352 

grouped. 187—215 

probit, 339-352 * 

representative, 160 

rounded, 187-223 

selection of, reasons for random step in, 158- 
160 

Ubular. 215-221 
time trends in, 371 

transformation of, to stabilize variance, 408- 
413 

on variables, 7 
Davis. O. L.. 389n.. 363 
Decimals, significant. 189n.. 190n. 

Decision function, 381, 382 

Decisions, based on inspection by attributes, 
7. 237 

by variable, 7 

baaed on sign of difTerenee between sample 
means, 377 

conditions rendering optimal, 381, 382 
probability of being wrong, 378-380 
figure for. 379 
table for, 378 

regarding largest of two or more variance esti- 
mates, 386. 387, 388, 389 
regarding level of performance of proceas or 
product, 61. 62. 377, 423 
regarding variability of processes (productsi, 
231, 233. 269'27i, 278, 27V, 280-283 
wrong. 271, 281, 282. 313 
Deckinger. R. L., 335n. 

Defective. 7 

Degreee of freedom (/.n.v) , in analysis of variance, 
312 

of X*. 153. 231. 232. 270 
division by. 12. 13. 43, 312 
ofF. 151, 287, 290, 312 

of numerator and denominator of F to be chosen 
equal, 206 

partitioning of, 312, 386 

of • or •<. 12. 13. 43, 109, 203, 270, 312, 387, 388 
of T. 155 

of T'-Btaliaties. 145, 152—154 
of t. 148. 203 
non-central. 73 

4; a constant in numerator of non-central t, 73 
Doming, W. Edwards, 110 
Department, of Agriculture, 352 
of Commerce (see Bureau of the Census; Na- 
tional Bureau of Standards) 

Navy fee* Bureau of Ordnance, Navy) 

War (»«e Army) 

Departures from normality, seriousness of, 49, SO, 
99. 346, 377. 381 

Derivation, of acceptance criteria, .'59-03, 66-71, 
263, 264, 270, 280 
of angular transformation, 410, 41] 
of Bartlett’s adjustment, 413, 414 
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Deiivation, of criteria for ‘immediate” accept- 
ance, in variables inspection for fraction 
defective, 66-71 

ol ” exact” test for independence in2 X 2 taUe, 
250-253 

of formnlfts for, A (adjustment constant), 70, 71 
A (critical level), 61. 62 
adjusted value of cbi or chi-equared. 254n. 
average number of observations, references 
to, 244 

Bartlett's adjustment, of inverse-sine trans- 
formation, 413, 414 
X«. 254n, 

critical level, 61, 62 
K, references to, 101, 108 
*, 50-63 

Lp. 30. 59, 61, 62 I 

hr. 261. 262 

number of observations needed, 60-63. 262- 
264, 380 

OC curves, 30, 50, 61. 62. 201, 262 
V>s. 413, 414 ' 

^ (a.^,nj.nt). 281n.. 316, 317 
probability that sample means ere in opposite 
order to population tneans, 378. 379 
p (a,d>n)i 315 

toleraTice-Umit factor, references to, 101, 108 
two-puint eatiiiiates of tt and v from probit 
data, 3,')0 

variances of, 361, SS2 

variability of amount of inspeetioa. references 
to, 244 

of general formulas for critical level and sample 
sixe, 6J , 62 

of general tranforination to stabilise variance, 
408-410 

of inverse-ame cranaformation. 410. 411 
of logarithmic transformation of »or •*.412, 413 
of optimum arrangement for estimating it and v 
from probit data, 349—352 
oi optimum choice oi adjustment constant. 70. 
71 

of rejection criteria, 50-63, 66-71, 263, 264, 270, 
280 

of square-root transformation, of a Poisson vari- 
able, 4)1 

of standard procedure for testing whether new 
process (product) is more variable than 
standard, 270. 271 

whether one process (product) is more vari- 
able than another, 280, 281 
of tolerance-limit factors, references to, 101, 108 
of transformation to stabilize varianee, 408-410 
of variances of two-point estimates of /> and «r 
from probit data, 350-352 

of z-traiioformation of correlation eoeflioient. 

413 

Design of experiments, 24.5-372 

abandoning prior to completion, witb provision 

for, 353-362 

for air-tesling bombsights, 116-128, 140-147 
analysis of variance, leailing to, 207, 310-314 
for cohiparing two means. 61, 62, 380, 381 


Design of experiments, two proportions or per- 
centages, 258-269, 424, 425 
two standard deviations nr variances, 267— 

318 

when cost of any one measurement depends 
upon its magnitude, 819-328 
when data are observations on cumulative dis- 
tribution, 339—352 
when data are probits, 330-352 
when decisions are based on signs of differences 
between sample means, 377-382 
for determining existence of components of ran- 
dom variation, 297, 319-314 
for determining maximum of a function, 363— 
372 

for determining whether level of performance 
of new process (product) exceeds standard, 
17, 27n., 28n„ 60-66, 81, 82, 423 
whether level of performance of one process 
(product) exceeds that of another, 61. 62 
whether variability of new process (product) 
exceeds standard, 209-278 
is leas than standard, 27S-280 
where variability of one process (product) 
exceeds variability of another, 28(^296 
for dosage-mortality studies, 339-352 
for estimating components of variance, 297, 
310-314 

factorial. 356, 306, 367, 369-372 
failure of equipment, with provision for rate of, 
355 

when independent variable is known only in 
terms of a probability distribution, 331-338 
for maximum of a function, 363-372 
for probit data studies, 339-353 
for proofing gun barrels, 331-338 
randomisation in, 141, 371 
rale of failure of equipment, provision for, in, 
355 

replication in. 141, 159 
tor aerwtrvxty beets. 339-352 
sequential, 417-429 

for determining maximum of a function, 367- 
372 

when rate of failure of equipment is high, 
353-362 

when severity of any one test cannot be con- 
trolled precisely, 331-338 
Designs (Ae Experiment designs) 

Destructive tests, 9, 321, 331, 34l 
Deviate (eee Normal deviate) 

Deviation (eee Mean deviation; Standard devia- 
tion) 

Differences between means, acceptance criterion 
for non-evgnificance of, a known, 61, 62 
V unknown, 7 1, 72. 150 

aoalysis-of-variance test of significance of. 385, 
386 

design of experiments when decisions are to be 
baaed on, 61. 62. 377-382 
effect of grouping or rounding on test of, o 
known, 196-198 
« unknown, 200-203, 214, 215 
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Differeneea between means, F-test of, 385, 386 
number of observations needed for test of, a 
known, 61, 62 

a unknown, 71—73, 81, 82, 150 
one-sided teat, a known, sequentia), 423 
single sample, 61, 62 
a unknown, seqriential, 71, 83-85. 420 
single sample, 71, 72 
sequential test of, «- known, 423 
a unknown, 71, 72, 83-85, 426 
signs of, basis for decisions, 377-382 
i-teat of, sequential, 71, 72. 93—85. 426 
single sample, 71, 72, 81, 82, ISO 
two-sided teat, a known, Gl, 62, 426 
a unknown, 150, 42G 
yardsticks for, 150 

Differences between proportiona or percentagea, 
acceptance criteria for non-agnificance of, 
251-255, 263, 264. 424, 425 
angular representation of, 262. 264 
design of experiments fur testing, 358-265. 424. 
425 

number of observations needed for test of, 262- 
264 

sequential test for, 434, 43J 
single-sample test, approximate methods for, 
249, 250, 253-257, 263 
“exact" method. 350-353 
Fuloher-Zubin Item Analyser. 257, 358 
incorrect method, 256 

(iSes also Binomial distributions, experiments 
for comparing parameters of two) 

Digits, significant, 189n., I90n. 

Discontinuities nf sampling distributions, result- 
ing from grouping data, 303-218 
Discriniinant function, best, for discriminating be- 
tween two populations of known form. 381. 
382 

Discriminating power of experiment. 269 
Dispersion, measures of (see Mean deviation; 

Range; Standard deviation) 

Distribution, of adjusted value of chi (xe), 255 
of amount of inspection, with double, multiple, 
and sequential sampling, 235-244 
computational methods for determining, 244 
figures showing. 241, 343 

nature of, in repeated sequential sampling, 
428 

of angular difference between two proportions 
or percentages, 263, 264 
of arithmetic mean. 197, 198 

when data are grouped, 196-198, 203, 212, 
213 

of aveiage error, 163, 163 

of Bartlett's test for homogeneity of variance 
estimates, 387, 388 

beta function, incomplete, 333, 334, 338, 393- 
394 

binomial, 250, 251, 421, 427 
bivariate normal, 146 

of chi, corrected for coiitiniiity (xc), 253 
of chi-squared (x*), formula for, 270 

percentage points of, 108-110, 258»., 315 r. 
relation to P-distnbution, 316 


Distnbution, of chi-squared (x^), relation to 
normal distribution. 258n. 
to st-distribution, 270, 315 
to r-distribution, 155 

of Cochran's test for significance of largest vari- 
ance estimate, 389, 392, 3U3 
of correlation coefficient, 413 
cumulative, 339-362 
Error (see N'ormal distribution) 
of error of an interpolated value, 221 
of F, formula for, 281 

relation tu clit-aquared efistributiun, 816 
to incomplete beta function, 392, 303 
significance levels of, 394 

detailed references to, 317n. 

Paulson's apprnximatinn, 303, 394 
when data are rounded, 214, 215 
Ca'iasan (fee Normal distribution) 
generalized normal, 197 

(See also Grara-Charlier series) 
of generalised Student ratio (T), 155 
of Hotelling's T, 155 
/•shaped, 194, 222 
kurtosis of a, measures of, 197, 198 
of mean («ee Distribution of arithmetic mean) 
of mean deviation. 162, 163 
of median, 162 

moments of, about origin, 193 
about true mean. 195 
centroidal, 195 

effeci of grouping or rounding on, 193-196 
ideal. 193 
lealistio, 193 

of in double, multiple, and sequential sam- 
pling. 235-244 

votripulatioual methoda for determining, 244 
figures showing, 241, 243 
nature of, in repeated sequential sampling, 
428 

non-centraW, 8n., 22, 64, 71-82 
use in variables inspection for fraction defec- 
tive. 71-82 
non-normal, 99. 38l 
normal, figure showing, 10 
formula for. 161 
(See also Normal distribution) 

Poisson, 411, 412. 426 

relation to x* distribution, 109 
of proportions or percentages, 250, 251, 263, 
264. 397 

(See also Binomial distribution) 

of T, 413 

of range, 229, 250, 234 
rectangular, 193, 214, 215 
of ■ or «*, S8, 199 

when data are grouped or rounded, 193-200, 
203, 204 

relation to x* distribution. 270, 315 
semi-invariants of, 19Cv. 
skewness of, measures of, 197, 198 
of Student's I, 201, 202 

when data are grouped or rounded, 200, 
203. 214, 215 
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Distribution, of Student's c, 187, ISA, 200 
of r, 154. 155 

relation to x* distribution, 155 
relation to F-distribution, 155 
of T’-statistics, 152-155 
of t. 72, 148 

effect of grouping or rounding on, 200-203, 
214, 215 

non-central, 8n., 22, 64. 71-82 
percentage poinOi of, 148, 148n. 
of variance ratio (F), lorTonla for, 281 
relation to x’-distiibution, 316 

to incomplete beta function, 302, 393 
significance levels of, 394 
detailed references to, 317n. 

Paulson's approximation, 393. 394 
when data are grouped or rounded. 314-215 
of ±, 197, 198 

when data are grouped or rounded, \96. 198, 
203, 212, 213 

Division of War Uesearch, Cdumbia University, 
vii 

Dodge, Harold F., 8n., 93 
Doeage<mortality curve, 342, 343n., 352 

design of experiments tor determining. 339-352 
Double dichotomy, analysis of data in form of, 
sequential, 424, 425 
single sample, 250-2.58 

approximate method (*«). 253-255 
"exact" method. 250-253 
design of experiments leading to, 258-265 
number ol trials needed, 2.58-261 
torimila fnr, 2,59, 2C0 
nomogram (or, 260 

operating characteristics ^OC> of single>(Htmple 
test, 201 

OC curve, figure for, 263 
formula (or, 202 
OC surface, 261, 262 
sequential analysis applied to, 424. 42.5 
Double sampling, attributes inspection for frac- 
tion defective, 237-244 

average amount of inspection, compared to 
multiple and sequential sampling. 238-249 
computational methods for, references to, 244 
figures showing, 240, 242 
characterised by relation of rejection number 
(Rsl to acceptance number {At), 237 
variability of amount of inspection k(JV)l. com- 
pared to multiple and sequential sampling, 

238-244 

computational methods, references to, 244 
figures showing, 241, 243 
Dwyer, Paul S., 172n., 183 

E 

Economic time series, 177 

Efficiency, of sample statistics os estimators of 
population parameters, 227n. 
arithmetic mean as estimator of «i, 162 
when data are grouped or rounded. 197 
mean deviation as estimator of v, 163 


Efficiency, of sample statistics as estimator of 
population parameters, median as esti- 
mator of p. in normal samples, 102 
range as estimator of ir. 227 
s as estimator of ir, 162, 227 
of sanipling-inspectioii plans and proccduies, 
attributes versus vat tables, 26-28 
double sampling, versus multiple and sequen- 
tial,' 237-244 

multiple sampling, versus double and sequen- 
tial. 237-244 

sequential sampling, versus non-sequential, 
26. 85. 237-244, 419, 420 
single aampling, versus sequential, 26, 8,5, 
419, 420 

of statistical tools, 386n , 394 
Eisenhart, Churchill, in, ix-xii, 186, 268, 376, 384, 
390 

Elderton, W. Palin, ltt4n., 22'2 
Enumeration data (see Attributes; Uinomial dia- 
tribution; Poisson distribution) 

«: probability of acceptance. 50 
«: probability that a normal deviate will exceed 
Kt. 17 

Error, average, 162 

(See also Mean dev-iation) 
components of. 269. 297, 310-314 
of first kind. 271, 281, 282 
grouping of. 187-180, 195. 218, 222 
of interpolated value, 218, 219, 222 
of meaaiiremenl, 188, 180 
probable, I87n., 223 
random. 269, 297, 310 
of aecond kind, 271, 281, 282 
standard (see Standard deviation) 
systemalic, 222, 310 
of tabular value, 215-218, 221 
Ksliioate, statistical use of the term, 12 
Estimation, abandoned prior to comidetion, 855, 
356 

by confidence intervals, 42, 43,9'J, 100, 332-336 
effect of grouping or rounding on, 192, 106- 
203. 213-215 

nf fraction dofeedve, by sttiibiites inspection, 
332-336 

by variables inspection, 42, 43, 58 
of maximum of a function, 363-373 
of (» 4- A’tf. by i 4- ka, 58 

of population mean («<), from probil data (ob- 
servations on cumulative distribution), 343, 
350 

by sample mean, 12, 58, ICl, 1C2, 192 

effect of groui>iuK or rounding on. 187, 188. 
196-198, 2(10, 203, 212, 213 
by sample median. 161, 162 
from een&itivity data, 343. 350 
of population proportion (F;, by confideiicc 
belts, 332-336 

by sample proportion (p), 397, 410 
from transformed proportion («), 403, 404 
of population standard devislinii (v), from pro- 
bit data (observations on cumulative dis- 
tribution), 343, 350 
from mean deviation, 163, 163, 169 
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Estimation of popuiatian atatniard deviation (s), 
(rom s, 12, 58 

of population variance (tf*). by mean deviation, 
162, 163, 169 
by si, 162 

whoa data are grouped or rounded, 196- 
200, 212-214 

eequential, reference to, 238n. 
of alupe and intercept of regression line, when 
cost of each mea&urcrrkent dei>ends upon Its 
magnitude, 819-328 
when probit data are involved, 343 
of atatistical tolerance limita, 97—110 
“Exact" method, for analyzing 2X2 table, 259- 
253 

Expected value, 397, 408 

of mean deviation, in normal samples, 169 
of p, in binomial aamplea, 397. 410 
of ^(p) and <eg(p), 403, 404 
tables giving, 400-402 
of range, in normsJ samples, 227it. 
of a, in normal aamples, 58 
of ti, 192, 412 

when data are grouped or rounded, 199, 212, 
213 

of i, arbitrary population, 197. 198 

when data are grouped or rounded. 197, 198 
of 4 + *8, 58 

Experiment designs, factorial, 356, 966, 367, 369- 
372 

definition of, 366n. 

problems for which ideally suited, 366 
seQueotial, 417-429 

for determining maximum of a lunotion. 367- 
372 

when failure rate of equipment is high. 353- 
362 

(See alto Sequendal analysis; Sequential* 
sampling-inspection plana) 

Experimental method, compared to standard 
method, 250 

Experimentation, when cost of each rneoatirement 
depends upon ite magnitude, 319-338 
when failure rate of equipment ia high, 355, 356 
when measurements are obeervatione on cumu- 
lative diatribution, 339-352 
role of randomization in, 141, 142, 100 
role of replication in, 159 

when severity of any one test cannot be con- 
trolled precisely, 331—338 
(See alto Design of experiments; Experiment 
designs; Experiments) 

Experiments, abandoning prior to completion, 
provision for, 355, 356 

for ammunition-proofing of gun barrels, 331-338 
metallurgical, 321 

(Sea alao Design of Experiments; Espeziinen- 
tation; Experiment designs) 

Extreme observations, 234 

F 

F: the variance ratio, or any random variable 
having the variance-ratio distribution, 151, 
152, 155, 281 


F: the variance ratio, analysia of variance, uses 
in. 311-314 

definition of, customary, ambiguity of, Idln. 
general, 28l 

for grouped or rounded data, 215 
degrees of freedom ambisuify re- 

garding, ISln. 

unambiguous specification of, 281 
distribution of, formulii for, 281 

percentage points, I’aulson's approximation, 
393, 394 

relation to percentage points of x^dis* 
tribution, 316 
Fisher's z, 317n. 

incomplete beta function, 392. 393 
tables of, references, ISln., 184, 3l7n,, 318 
comments on, ISln., 152n , 317n. 
distribution of log F, when degrees of freedom 
are equal, 152 
«*•. 317n. 

formulas for, general, 281 
for grouped or rounded data, 215 
speeisl, 151/ 160 
relatioivship to x'> 215, 281, 316 
to Fisher’s t, 317n. 
of Hotelling's 3’ to. 155 
to incomplete beta function. 392, 303 
aigiuficance levels of, Paulson’s approximation, 
303. 394 

relation to significance levels of xi-dislrlbu* 
Uon. 316 

of incomplete beta function, 302, 393 
tables of, references to, loin., 184, 317n,, 
318n. 

comments on. ISln., 152n., 317n. 
test of homogeneity of sample means, 385, 386 
compared to Bartlett's test for homogeneity 
of variance cellmates. 386 
discriinioaiing power of, improved by parti- 
tioning comparisons, 386 
as ''omnibus" test, 386 
test of ratio of two variance eatimates, 289--316 
use in plaoiiiiig and interpreting experiments 
for comparing two standard deviation or 
variance estimateB, 280, 283, 296 
for detecting presence of components of 
variance, 311—314 

for determining whether one process (prod- 
uct) is more variable than another, 280- 
283. 296 

F(ff ) : any function of N that is independent of v, 

61 

/: degrees of freedom of chi-squared (x*), 75 
Factorial design, of experiments, 356. 366, 367, 
369-^72 

definition of, 366n. 
oituationa for which ideal, 366 
Factorials, in “exact" analysia of 2 X 2 table, 
251-2.53 

logarithms of, reference to tables of, 253n. 
Failure of equipment, allowance for rate of, in 
planning experiments, 355-362 
Ferris, C. D.. 318«. 

Fiducial limits (see Confidence limits) 
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FiKurea, list of principal, xiv 
Fire-control devices, 249 

Fisher, Ronald A., 18, 93, 109, 116. 120n., 148 n., 
151, 152n.. 159n., lC3n., 167, 177it.. 183. 
192n.. 197, 200, 201, 203 , 211*., 212. 218. 
219n., 220, 221, 222, 232, 234. 250i».. 2.5.5, 
258n., 265, 27<1 ti,, 207 , 313n., 317n.. 318, 
325rt., 328, 342n., 343n,. 352. 36r.«., .372, .308, 
390, 400, 405, 407, 413, 414n.. 415 
Fisfier-Cornish type of expansion, 109 
Five-point OC curve, 28-30, 427 
Flatness of probability distribution (see Kurtoms) 
Forman, H, Iri,-ing, i 

Formula, for A (adjustment constant), 41. 54, 70, 
71 

A (critical value of likelihood ratio), 420 
A (critical value of normally distributed test 
function), 62 

A (function in formulae for sequential varishlea 
plan for iraction defective), 84 
Xi, in terms of Rt. 237 

a (critical value of K in sequential analysis). 84 
420 

a (multiple of e in formula for mean of •). 58 
acceptance criterion, in analysis of variance, 
312. 31.3 

for difference of means, 61, 62 
for difference of proportions, 263. 264 
general, in sequential analysis, 420 
with (large) eiiiale sample. 61. 62 
for mean. In sequential teet, 123 
in single-sample test, 6i. 62 
for proportion, in sequential teat, 422 
Is single-sample teat, 260 a., 264 
when range in samples of i determines lot 
quality with Single sample, 229. 232 
for ratio ol two variance estimateo. 281. 283 
for in single-sample test. 232, 270, 279 
in variables inspection for fraction defective, 
12, 33-35. 37. 41. 60-71 
acceptance line, for number of ‘'successes," in 
binomial teat, 422 

(or number of "succeas-failure” poirs. in 
double-dichotomy teat, 425 
for sum of observations, in lest for p, with <r 
known, 423 

for sum of squared deviations, in test for er, 
with M unknown, 232 
adjusted value of chi (x<). 254, 257 
adjustment constant (A), 41. 54, 70, 71 
adjustment of k, N &xed, 19, 20 
amount of inspection, attributes plan, sequen- 
tial sampling, 427, 428 
single sample, 259, 260n., 263, 2C4 
binomial test, one-sided, eequenlial soiopline, 
427, 428 

single sample, 259, 260n., 263 , 204 
when decisions are based on signs of differ- 
ences between sample means, 380 
diderence of means test, ^ known, 61 , 62 
c unknown, 17, 27n,, 28n., 60-6G, 81, 82 
difference of proportions test, 259, 260, 263, 
264 


Formula, amount of inspection, double-dichotomy 
test, 259, 260. 2€3. 204 
fraction defective test based on variables, 17 
when ji is known and a unknown, 27n., 
28 b.. 231, 278n. 

when n is unknown and a known, 27n,, 
28n.. 62 

when fi and rr are both unknown, 17, 27n., 
‘28a.. 66-63 

general one-viatatnetec sequential tests, 427 
singl^aample tests, 61, 62 
mean test, a known, 27n., 28n., 62 
• unknown, 17. 27n., 28n.. 60-66, 81, 82 
proportion test, sequential sampling, 427, 428 
single sample, 259, 260n., 263-264 
when range in samples of 1; determines lot 
quality, sequential sampling, 233 
single sample, 231, 278n. 
standard deviation test, sequential sampling, 
233 

aingle sample, 231. 27Sn. 
variables inspection plans lor fraction defec- 
tive, 17 

when ji is known and a is unknown, 27n,, 
28 b.. 231. 278n. 

when u is unknown and v is known, 27n.. 
28n.. 62 

when It and c are both unknown, 17, 27n., 
28n.. 60-63 . 

analyeis-nf-vanance table, entries of, 312 
angxitai difference, betwren two binomial piuba- 
biUties, 262. 264 

between two observed proportions, 264 
angular transformation, 256, 398, 399 
modified, 401 

arithmetic meap. 12, 100, 101, 192 ^ 

asymptotic, for confidence limlU for population 
proportion, 336 

for percentage points of T’-distribution, l55‘ 
for percentage points of (-distribution, 148 
for tolerance-limit (actor K, 101 
A8N curve, for general one-parameter aequeu- 
Ual tests, 427 

for sequential one-sided binomial teat, 427, 
426 

with acceptance line omitted. 358 
(or eequenrial one-sided test of ir, 233 
b (critical value of —X in sequential analysis), 
84. 421 

b (function that appears in formula for k when 
S is fixed), 20. 59, 61 

5 (multiple of r/-\/2{S —1) in formula (or 
standard deviation of s). 58 
Rnrtlett'a adjustment, of inverse-sine trans- 
formation, 399 

Dartlett's test of homogeneity of variance esti- 
mates, 387 , 388 
beta function, incomplete, 392 
binomial distribution, 251 

boundaries of acceptance and rejection regions, 
sequential binomial test, 423 
sequential double-dichotomy test, 425 
sequential mean test, a known, 423 



INDEX 


449 


P'ormula, bouadsries of acceptance and reiecUon 
regions, segucntisl procedure for detcrnun- 
ing whetlier to complete or abandon an 
experiment, 33ft-361 

sequentisl standard dentation test, ft un- 
known, 232, 233 

single-eample variables inspection plana for 
fraction defective, 35-37, 41, 53, 54, 56, 57, 
67-71 
C2, 58 
X., 2S4 

x>, 254, 250, 267 
X*-distnbution, 270 

Cochran's test for significance of largest vari- 
ance estimate, 388 

approximate significance levels of, 392 
confidence limits, for parameter of binorruai dis- 
tribution, 335, 336 
control limits, (or means, 147-148 
correlation coefficient, transformation of. 413 
critical level (A) of normally distributed teat 
function, 62 

degrees of freedom, in analysis of variance, 312 
of T. 155 

of r'etatlatics, 145, 152-154 
i (/,lo,s). 74 

fur ssUmating varianco of linear regression 
fitted by weighted least squares, 343 
expected frequencies, in 2 X 2 table. 253 
expected valuo, of mean'devistion, in normal 
asmpfae. 159 

of p, in binomial saoiplce, 397, 410 
of 8, in normal samples, 58 
of s>, arbitrary populstion, 107, 108 
when data are grouped or rounded, 199 
of i, 197, 198 
of f -f Hi. SS 
F, general, 281 

for grouped or rounded data, 215 
special, 151, 169 
vi. 198 . 
yt, 198 

general transformation to stabilize variance. 
409 

generalized Student ratio (TJ, 154, 153 
hi and hi. 232, 233, 356. 357. 422. 423. 425 
UotclUng’s T. 154, 155 
interpolated value, error of, 219 
variance of, 219, 220 
interpolation without differences, 219 
inverse-sine transformation, 2.58. 398. 399 
modified. 410 
K, 101, 108 
Ka. 2C3 
Kff. 2C3, 264 
Ki, 17, 18, 31, 360 
i, 17, 19, 59, 6f>, 63, SJ, 82 
kurtosis, measures of, 197, 198 
Lz, 30, 51 
iv, 232. 233 
Lt, 262 

Lagrsn^n interpolation coefficients, 219 
m, 350 

mean (see Formula, arithmetic mean) 


Formula moments, of arbitrary distribution, 193 
when data are grouped or rounded. J93, 195 
average. 194 

of distribution ol e*, grouped and ungrouped 
data. 199 

of I, grou(>cd and ungrouped data, 190 
of i, grouped and iingrouped data, 198 
A7 (number of observations needed iti each of 
two samples). 259, 264, 380 
Af (number of observations needed in single 
sample), 17. 26, 28, 60-62, 72, 73, 81, 231, 
259, 260n., 264. 278n. 

Af. 253. 427, ^428 
U,. 26. 259, 260n.. 204 
ffm. 28n., 61. 62 
28n.. 231. 278fi. 

ATi, 17, 28n., 60, 61, 81 
uun-central 1, 72, 73 

normal distribution, 17, IS, 31, 161, 260, 263, 
423 

number of observations needed, with attributes 
luepecuon, sequential sampling, 427. 428 
single sample, 259, 200n., 2C4 
binomial test, one-sided, sequential samiding, 
427, 428 

eingte sample, 259, 260n., 264 
X’ test of variance estimate, 231, 278a. 
wlien decisions are based on signs of differ- 
ences between sample means, 380 
for determining whether level of performance 
of a process (product) exceeds standard, 
17. 28a., 60-62, 81 

whether variability of performance of a 
process (product) exceeds standard, S3l, 
278n. 

difference of means test, single sample, e 
known, df, 62 

e unknown, 17, 28n., 60, 61, 8l 
difference of proportions test, sequential 
sampling, 424, 427, 428 
single sample. 259, 260, 263, 264 
double-dichotomy teat, sequential sampling, 
424, 427. 428 

single ‘swinple, 259. 260, 263, 264 
fraction defective test baaed on variables, 17 
u known, v unknown, 2dn.. 23 1 . 27871. 
u unknown, v known, 26n., Cl, 62 
» and V unknown, 17, 28, 60, 61, 81 
general on^parameter tests, sequential 
sampling, 427 

single aample, 61, 62 

mean test, single sample, a known, 28n., 61, 
62 

■r unknown, 17, 28n., 60, Cl, 81 
proportion test, sequential sampling, 427, 428 
single eample, 259, 260n., 264 
when range in samples of determines lot 
quality, sequential sampling, 233 
single sample, 231. 278ri. 
for setting tolerance limits, references to, 109, 
110 

standard deviation test, sequential sampling, 
233 

mngle sampling, 231, 27$n. 
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Formula, number of observationa needed, vari- 
ables inspection plans for Irsetion defec- 
tive, 17 

p knovn, e unknown, 28n., 231, 27 Sr. 

P unknown, a known, 28n., 61, 62 
p and a unknown, 17, 28 r., 60, Cl, 81 
OC curve, for analyaia-of-variance teals, 313 
attribuCea inepecdon, single sample, 260n., 262 
binomial teat, one-decision, Be«)uential, 3S8 
one-sided, single eample, 260n., 262 
X* teat of variance eatiniato, 231, 232, 271, 
278n., 279, 313 

when decisiona are board on ^gns of differ- 
ences between sample means, 370 
difference of means teat, a known, 61-62 
a unknowTi, 30, 59-Gl, 62, 63, 72, 73 
difference of proportions test, single eample. 
262 

double^chotomy test, single sample, 262 
experiments for determining whether level of 
performance of one process or product 
exceeds standard, 30, 39-63, 72, 73 
whether variability of one process or 
product exceeds standard, aequeotial 
sampling, 233 

single sample, 231, 232, 271, 278n.. 279, 
313 

whether variability of one proeeas or 
product exceeds variability of another, 
282. 310 

F-tats ol variance estimates, 282. 313. 316 
fraction defectivo test baaed on variables. 
30, 49-63, 72. 73 

general one-parameteT testa, single sample. 
01, 62 

mean teat, single sample, « known. 61. 62 
« Mnlt-aown, 30. 40-01,62.63,71-73.76,77 
one-decision sequential binomial teat. 348 
proportion test, aingle eample, 260n-. 262 
when rauge in samples o( k determines lot 
quality, aequentiol asmpLing, 233 
single sample, 231, 232, 271. 278n.. 279,315 
standard deviation tests, 231, 233, 271, 27gn., 
279,282,313,314,316 * 

variables inspection for fraction defective, 
30, 60-03, 72, 73 
ifi and <pB, 309, 401 
^ (a,^,ni.ni), 282, 316 

probability that sample means will be in oppo- 
site order to population means, 379 
probiti variance of a, 360 

Rp, for one^lecision sequential binomial test. 348 
r, transformation of, 413 \ 

p {a,0,n). 231, 232, 271, 278n., 279, 315 

* (slope of decision line, in graphical procedure 

for sequential tests), 233, 358, 422, 423, 425 

• or ■*, 12, 43. 162, 192 

sample else (.$ee Formula, number of observa- 
tions needed) 

significance levels of Cochran's test, 392 
of T'-distribution, 145 
oi t-distribution, 148 

standard deviation, of observed proportion, 
254, 397 


Formula, standard deviation, of mean, 48 
of t, in normal aamploe, 48 
of e. 248 
ofz, 58 

of X -1- Jbs, in normal samples, 48 
{See also Formula, variance) 

Student's t, 200 
Student's r, 187n. 

T (angular difference between two binomial 
probabilities), 262, 264 
T (Hutelling's). 142. 144 
T’-statislics, 131, 133, 134, 145 
t (angular difference between two observed pro- 
portions). 264 
t (Student's), 200 
non-central. 72. 73 
i (/.«.«). 74 

toleranec-limit fm'tor (X), 101, 108 
two-point estimates of u and a from probit 
data. 3SO 

variances of, 341, 342 
transformation to stabilise variance, 409 

(■See alto Inverse-sine transformation! t- 
transformation) 

variance, of angular difference between two 
olMerveii proportions. 2C4 
arithmetic moan, 162 

when data are grouiied or rounded, 198 
binomial distribution, 397, 410 
correlation coeincient. 413 
“error” due to sroupine or rounding, 195, 
218 

grou|>e<i or rounded variable, 195 
interpolatod value, 319 
mean. 162 

when data are grouped or rounded, 19R 
median. 162 
and ve. 4(K), 407 
Poisson distribution, 411 
probit. 350 

proportion, 397, 410 
r. 413 

t*, arbitrary population, 199 

when data are grouped or rounded, 199 
( (angular difference between tn-o observed 
proportions), 264 
9 (transformed proportion), 400 
two-piHnt estimates of /< and v from probit 
data, 351, 342 
£. 162, 198 

variance estimates, 12, 43, 162. 192 
£. 12, 43. 100, 192 

yardsticks, (or differences of means, 150 
Fourfold table (see Double dichotomy) 

Fraction defective, definition of, 10 

dependence upon n and v of items in lot, 10 
as measure of lot quality. 11, 42 

(See alto Acceptance in pection, (or fraction 
defective) 

Frankel, Lester, 1497t., 144n., 184 
Freedom, degrees of (see Degrees of freedom) 
Freeman, Harold A., ix, 419n., 428 
Frequencies, expected, in 3 X 2 table, 253 
Frequency distributions (see Distribution) 
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Friedman, Milton, ix, xi, xii, 6, 320, 340, 364, 
419n. 

Fry, Thornton C., 253n., 265 
Fulcher, John S., 257n,, 265 
Fulcher-Zubin Item Analyicr, 267, 2.58 
Function, experimental determination of 
maximuzn of, 363—372 

G 

F: confidence coefficient associated with confi- 
dence belts for parameter of binomial distri- 
bution, 335, 336 

y: a confidence coefficient, 42, 43, 98, lUO, lOS, 
332, 336 

7<: confidence coefficient used in judging whether 
to continue normal inspection, 44 
yr. confidence ooefCcieut used in judging whether 
to resume normal inspection, 44 
7i: Fisher's measure of akewnoas, 197, 198 
71; Fisher’s measure of kurtosis, 197, 198 
Gamrna distribution (see Chi-squared distribution) 
Gaussian distribution (see Normal distribution) 
Geary, R, C.. 201. 222 

General one-parameter testa, sequential sampling, 
426-428 

single sampling, 61, 62 

General trausfornatirm to stabilise variance, 4(*9 
Generalised normil curve, 197 

(<S<s alto Gram-Charlier series) 

GensrsUted Student's rslio (T), definition of, 142, 
164, 153 

distribution of, 15-1, 155 

asymptotic ezpensiou (or percentage points 
of, 155 

free from nuisance parameters, 115 
relation to x*-disCribution, 155 
to F-distribution, 155 
optimum properties of, 147 
as ’’ score," combining results of two or more 
teste, 113-116 
Generalized variance. 1G6 

Oirehick, Meyer A,, ix, xi, xH, 6. 226, 238n., 244, 
354. 419 

Glaieher, J. W. L., 191, 222 
Gloeeary (or Chap. 1 , 85-92 
Goldberg, Henry, x, 83»., 109. J49n., J84 
Goeset, William Sealy, 187 
(•Sec also Student) 

Gram-Charlier series, 197 

Grsphicai procedure^ for analysing binomial data, 
260-262 

binomial-probability paper, reference to, 414 
nomogram for, 260 
Zubin's, 398. 416 

for determining whether to abandon or com- 
plete an experiment, 350—359 
worked example, 359-361 
in sequential analysis, binomial test, one-deci- 
sion, 358 
one-sided, 422 

comparison of two proportions, 425 
double-dichotomy test, 425 
mean teat, r known, 423 
proportion test. 422 


Giaphical procedure in sequential analysis, 
standard deviation tE>st, u unknown, 232, 233 
in variables inspection for fraction defective, 
34-37, 41 

adjustment constant (A), 36, 37, 40, 60-71 
optimum choice of, 41, 54, 70, 71 
advantages of, 36 

boundariee of acceptance and rejection re- 
gions, figures showing, 38-40 
formulas for, 35-37, 41 
derivation of. 66-71 

■lapoasible region, indicating a mistake, 36, 37 
figures showing, 38—40 
when upper and lower limits on a single 
quality characteristic define acceptable 
quality, 52-56 

one two-sided criterion, 54-57 
pair of one-sided criteria, 63, 64 
Grouped data, impossibility of avoiding use of. 
187, 188, 189 

Grouping (of data), 187, 188, 191-215 
effect of. on desctiplive statistics, 187, 188 
on distribution ofF, 214, 215 
of.»’. 198-290, 203-214 
off, 200-263, 214, 215 
of z, 166-198. 312, 213 
on eaiJmatJon, 0/ popiilslion mean, 197, 195. 
200-203 

population variance, 105-200, 203-214 
on momenta, 193-19C 

representation as elTect of a random group- 
ing or rounding error, 195, 218 
on standard proeedurea of statistical infer- 
ence. 191-216 

with large samples, 191-203 
with email samples, 203-215 
iznposnbility of avoiding, 187, 155, 159 
reasons for, 187 

Grouping interval, recommended choice of eise of, 
192, 214 

Grouping lattice, effect of position of, on distri- 
bution of e*. 200-213 
on distribution of i, 212, 213 
on estimation of n and by i and respec- 
tively. 212. 213 
raodom location of. 194 

extends validity of Sheppard's corrections, 
196 

when only non-negative observations can 
“ occur, 196 

Groups, variation within and between, 312 
Grubbs. F. El., 318n. 

Oun barrels, pressure proofing of, 331-338 
H 

h: number of lots from wliicL samplts are taken 
and combined for computing process average, 

42 

hi: negative of intercept of lower decision line 
(acceptance line) in grophical procedure for 
sequential tests. 42G 

formula, for binomial test, one-sided, 422 
double-dichotomy test, 425 
oiean teat, v known, 423 
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ht'. negative of intercept of lower decision line 
(acceptance line) in eraphical procedure for 
seQuential tests, formula, standard deviation 
test, a unknown, 233 

taken equal to infinity, to provide for rejection 
only, 358 

use in constructing five-point OC curve. 427 
/i>: intercept of upper line (rejection line) in 
graphical procedure for sequential tests, 426 
formula for, liinomial test, one-dcciMon. 358 
one-sided, 422 
double-dichotomy test, 425 
mean test, v known, 423 
standard de^dation teat, unknown. 233 
use in constructing five-point OC curve, 427 
Hall.-Philifr, 218n., 222 
Hartley, H. O., 38Cn., 304 
Haatay, Millard W., iii, ix 
Hayashi, Keiichi, 402 a., 416 
Histogram, representation of population to which 
grouped data carrespond, lOS-lOS 
Homogeneity of biiioiuiul disUibuUviiH, experi- 
ments for testing, 240-203, 424, 435 
analysis of datu from, sequential sampling. 

424-425 

single sample, 240-258 
planning of, sequential. 434 
single sample, 25S-265 
of means, 61-03. 385-386 
of proportions. 240-365, 424, 425 
of 2 X 2 table. 240-265 
o( vatianee eatimatea. 385-380 
Bartlett's teat for, 385, 386, 387, 388 
Cochran's test for, 386, 337, 388, 389 
significance levels of, tables of, 390, 391 
Homogeneous variance, advantages of. 397, 398 
testa for, 385-380 

transformation of data to achieve, general 
formula for, 408, 409 
examples. 410-413 

Hotelling, Harold, ix, xi, 112, 114n.. 149n.. 154n., 
155n.. 172n., 184. 305a., 368n.. 371n., 372. 398 
Hotelling's T, definition of, 142, 154, 155 
distribution of, 154, 155 

asymptotic expansion lor percentage points 
of. 155 

free from nuisance parameters, 115 
relation to x*-distnbution, 155 
to F-distribution, 155 
optimum properties of, 147 

as “score." combining results of two or more 
teats, 113-110 
Hsu, P. L., 147, lOCn., 184 

Hypotheses, statislical tests of (fee Statistical 
tests) 

Hypothesis, alternative, 419, 420 
null. 420 

under test, 419, 420 

I 

Ignition current, 341 

Immediate acceptance, criterion for, in variables 
inspection for fraction defective, 34, 37, 41, 
07, 69, 70 


Impossible region, indicating a mistake, 36, 37 
figures showing, 38-40 

Inconsistent requirements in specifications, 50n, 
Independence of acceptance tests, 51 
tables for, 249-255 

(See also Double dichotomy; 2X2 tables) 
of £ and s in samples from a normal population, 
200 

efteet of grouping or rounding on, 187, 20 1 
Indiflerence quality, definition of, 20 

use in variables inspection for fraction defec- 
tive, 21 

Indifference value, 282 

Inferences about population (see Estimation ; 

Statistical tests) 

Iniorrnstion about lot. 7 

inspection, acceptsnee (see Acceptance inspec- 
tion) 

amount of (see .\mount of inspection) 
cost of (see Cost; Amount of inspection) 
curtaUed, 14. 238, 361 
deatcuciWe, 9. 321, 331, 341 
normal, 43, 44 

plan, considerations involved and steps in 
chooaiug. 45-49 
reduced. 41—45 

sampling, effectiveness of, 158-158 

(5es also Operating-characteristic curves) 
objections of. 156-168 
risks involved, 228, 229 

(See aleo Consumer’s risk; Producer's risk) 
value of. dependent on quality of submitted 
product. 42 

for several quality charseteristics, 60-52, 1 13- 
116 

lightened, 41-45 
variability of. 235-241 
by variabl«i (see Venables, inspection by) 
Interpolated value, accuracy of, 210, 220n., 221n. 
error of. 219 

ptccteion or variance of, 219-221 
Interpolation, 218-221 

coefficients, Lagrangian, 108, 109, 210, 222 
Salser’s inverse, 100 
without differences, 219 
harmonic in 4 or n, 317, 388 
in 

inverse. 109 

probability wise, 316n., 318 
Interpreting, analyais-of-variance experiments, 
297. 310-314 

experiments for comparing two proportions, 
249-258 

for comparing two standard deviaiiona, 267- 
318 

for determining whether variability of new 
process or product exceeds standard, 
267-278 

is leas than standard. 278-280 
(or detcTnuning wbetber otic of two pToccssce 
is more variable than another, 280-296 
experiments when severity of any one test 
cumot be controlled precisely, 331-338 
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Inverse hyperbolic t&nBenti 413 (see s-tranafonna- 
tion) 

Inverse>sijie transformation, of proportions, to 
stabilize variance, 257-259, 261-264, 336, 
395-416 

adjuaCment of, 399, 401-407 

refereneea to, 399n., 405n., 407n. 
table to facilitate, 406 

Bartlett's adjustment of, 309, 401-407, 413, 414 
Bartlett's form of, 398, 406, 401 
bias of, 403, 404 
bibliography for, 414-416 
derivation of, 410, 411 
effectiveness of, 401-408 
figures showing, 400-402 
tables showing, 403-405 
forma of, Bartlett's, 398, 400, 401 
Blin', 398, 400 

Fisher's original, 398, 399, 400 
SRG's first version, 405, 406 
Yates’, 398, 400 
Zubin's. 257. 258. 398. 405 
history of, 398 
nature of, 399-400 
presentation of final results, 407 
tables to facilitate application of (««e Bibliog- 
raphy, 414-416) 

uee to determine confidence limite for binomial 
parameter, 336 

to determine number of trials needed in 
experiments for comparing two propor- 
tions. 259, 200 
formula tor, 259 
derivation of. 261-264 
nomogram baaed on, 260 
use to determine OC curve of experiment for 
comparing two proportions, 261. 262 
use in sequential analysis, references to, 405n., 
416 

Irwin, J. 0., 218n., 222 

Isaacson, E,, 416 

J 

y-shsped curves, 194, 222 

Jennett, W. J,, 8n., 49, 68n., 72n., 93, 99 

quotation from paper by, with B. I-. Wedeb, 49- 
60 

Johnson, N. L., 8n., 22, 64, 72, 73, 74, 76. 77. 79. 
86. 93 

K 

K: difference between upper limit (IT) specified 
for a variable and its population mean {$>), in 
units of population standard deviation (v), 
9-13 

K: minimum proofing pressure preecribed for gun 
barrels, 331 

K: multiple of s used in setting tolerance limits, 
97-100 

formulas for, 101, lOS 
table of values for, 102-107 
uses of, examples of. 100, 101 


Ka'. normal deviate exceeded with probability a 
(producer's risk, or probability of an error of 
first kind), 17. 278n. 
formula for, 263 

relation (of Ka*) to percentage points of y>-diB- 
tributioo. 25Sn. 

use in acceptance inspection, for average 
performance, 61, 62 

for dispersion of performance, 231 , 232, 278n. 
for fraction defective, by attributes, 259, 
260n.. 261-264 

by variables, 17-21, 60-63, 81. 82 
for fraction of sample ranges leas than 
apecified limit, 231, 232 
for mean quality of lot, 61, 62 
for standard dev-iation of quality in lot, 231, 
232, 278b. 

use in formula for critical level (A) and number 
of observations needed in general single- 
sample, one-parameter test, 61, 62 
use in planning experiments for comparing two 
proportions. 258-264 

for comparing two standard deviations or 
variances. 278n. 

use in probabibty-wise interpolations in per- 
eentage-point tables. 3l6n. 
use in variables inspection for fraction dsfee- 
live. 17-21, 69-63, 81. 82 
(Su alao K<) 

Kfi: normal deviate exceeded with probability 
(consumer's risk, or probability of an error 
of second kind), 17, 278>t., 380 
formula for. 263, 264 

iiae to determine number of observations needed 
when decisions will be based on signs of 
differences between sample means, 380 
(5s« aUo Ka, uses (or-, K () 

Ktt normal deviate exceeded with probability (, 
17, 380 

formula for, 17, 18, 31, 260 

relation to "probit, '* 343 

tables of, refereiices to, lOn., 18, 343n. 

need for cere In using, lOn. 
use in asymptotic expansion for percentage 
points of 4-diatribution, 148 
uses, other (sse Ka and Kg; fCi.y; ifo; JTi; Kt) 
Kx.y: normal deviate exceeded with probability 
I - T, 336 

normal deviate exceeded with probability 
po. 21 

Ki: normal deviate exceeded with probability 
pi, 17 

Kt: normal deviate exceeded with probability 

pT, 17 

k: coefficient of s in variables inspection plan for 
fraction defective, 12-14, 16-26 
sd>ustmeat of, when K is fixed, 19, 20 
approximate evaluation by formula, 17-20 
comparison with exact values, 64-66 
exact evaluation, from indifference quality, 21 
usina non.central {-distribution 71—82 
formulas for. 17-20 

derivation of, 59, 60, 02-63 
table of values, 22-25, 05 
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k: coefficient of s in variables ioapection p)an for 
fraction defective, uses of, additional. 27n., 
2Sn. 

ki number of items the range (Rt) of which ia 
critical. 227, 228 

k: number of samples to which a given acceptance 

Qucnber (Ak) or rejection number (Ri) 

corresponds, 237 

(5ee also Acceptance number; Itejection 
number) 

kA: acceptance level for k» in sequential variehlea 
inspection for fraction defective, S4, 85 
kn: observed difference between upper limit (U) 
and samriic mean (S) in unite of a; sample 
estimate of K, 43 

use in sequential variables innpection for 
fraction defective, 84. 8o 
fca; rcjcctiou level (or fc« in aequeniial variables 
inspecllon for fraction defective, 84, 8o 
^/n times coefficient of « in acceptance 
criterion, used when items are eventually 
assembled in sets of n, 46 
Kelley, Truman Lee, 18, 93 
Kendall, Afauricc G.. I20n., 184. IDfin,, I99ft.,222 
Kobn, Aime Frankenlhalcr, x 
KurtoaiJ, measures of (dt.irr). 197. 198 

of distribution of error of an interi>oiated value, 
221 

of tample mean wlien data ate grouped ot 
rounded. 197. 198 

L 

L: upper limit of a measured quality character* 
istic, above which an item is defective. 72 
(Set alto U) 

L»-. probability that a lot of fraction defective p 
will be acceptsd by a given acceptance 
inspection plan •/ submitted, 15. 16. 28 
evaluation of. 28-33, 50-52, 76,77, 80, 358, 361. 
427 

use of, in determining confidence limits for p, 
43-15. 336 

* L^: probability of concluding that et* < vi* when 

«rii B 282 

curves showing, for F-tests of variance esti- 
mates, 29G. 207, 318n. 

evaluation of, for F-tests of variance estimates, 
282-296, 316, 317 

hfi probability of concluding that vi* < <r»* when 

tfi* = fwa*, 278 

curves showing, for x^test of variance estimate, 
274, 275, 318n. 

evaluation of. (or aequential aampling (see L^) 
for Bingle-eample exact procedure, 

271-278, 279, 315 
large-sample formula for (seeLo) 

Lo\ probability of concluding that vi <«i when 
VI w V, 232 

curve showing, for aequenlisl test, 234 
evaluation of, for sequential sampling, 233 
for single-sample x^- teat, exact procedure, 232 
large-sample formula for, 232 


Lr: probability of concluding that Fs > Pa when 
true angular ditference between Pm and Pg 

is T. 262 

curve showing, 262 
evaluation of, by formula. 262 
from nomogram, 263 

La~ pcobabiltty of concluding from likelibood ratio 
sequential test that 0 < So, as a function of 
the true value of 6, 427, 428 
1 / 11 , 0 '. probability that a lot ot mean ft anil standard 
deviation v will be scoepted by a given ac- 
ceptance inspection plan (/submitted, 16, 52 
l,agrangian interpolation coefficients, 108. 109, 
219, 222 

X: natural logarithm of ratio to two probabilities 
or probability densities, computed after each 
observalion in sequential analysis, 83 
X (//«,<) : function of /, («, and « used in calculation 
of i and i (/,{.t) from tables of non- 

central ^distribuUon, 74. 75 
Xi: value of X (/4t.e) computed in determining 

Pi^> 82 

Xt: value of X (/,{»,*) computed in detsrminiog pfi. 
82 

Landau. E., 408n. 

Langdon. W. IL. 19rm.. 196n.. 222 
Large samples, formulas and procedures valid for, 
17-21, 30-33. 43. 58-63, 81, 82, 101, 108. 109, 
U8. U9n.. 155, 162-163. 100. 231, 232, 263. 
264, 278n., 336. 377-381. 393. 399-401, 407. 
408-413 

accuracy of. 64. 65. 401-407 
when data are grouped or rounded. 190-203 
Least squares, applicalion of. when cost of each 
measurement depends upon its magnitude, 
319-328 

vhen data aie observations on cumulative dis* 
tribulion. 343, 344 
refersDcee to, 343n., 352 
Lethality of drugs, 341 
Level of significance, 270. 271, 281 
Levine, Ilarriet, x. 6, 100, 149n., 184 
Levine, Myra, x. xi, 230 

Likelihood ratio, as basis for sequential tests, 63, 
410-421 

definition of, 420 

formula for logarithm of (X), in sequential bi- 
nomial lest, 421 

in sequential double-dichotomy test, 424 
in sequential mean teat, v known. 423 
V unkaown, 64 

in sequential variables inspection for fraction 
defective, 84 

Lamita. confidence (lee Confidence Vimite) 
eontrol («ee Control limits) 
of normal i~ariation (see Tolerance limits) 
tolerance (see Tolerance limits) 
lindley, D. V.. 281n. 

Linear regression, when cost of each measurenient 
depends upon its magiutude, 319-328 
when data are observations on cumulative dis- 
tribution, 343, 344 
rcferencea to, 343n , 352 
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Location, estimation of parameters of (see Esti- 
mation; Mean; Median) 

Logarithmic scale, 321 
Logarithmic transformation, 412'413 
{See aUo s-transformation) 

LogaritJima, of factorials, 2o3 
reference to tables of, 25<In. 

Lot, acceptability of, determined by average 
quality, 8, 27, 28, 61-63 
by dispersion of quality, 8, 27n., 28n., 220, 
269, 270, 278-280, 283 
by fraction defective, 7, 8 
by fraction of averages of samples of n that 
exceed specified limit, 48 
by fraction of ranges Bs in samplea of k that 
exceed specified limit. 228, 2*29 
formulation of, in terms of », 220-231 
by mean quality (ji). 27. 28. 61-63 
by mean (p) anJ standard deviation (*) of 
quality, 11 

by several quality characteristics. 60-52. llS, 
114 

by standard deviation of quality. 8. 27n., 
28n., 229, 260, 270. 278-280, 283 
by upper and lower limits on a single quality 
charactsriatie, .^2—56, 63. 64 
(See cleo Acceptable quality; Acceptable- 
quality level) 

acceptance of, meaning of. 13-U 
procedure for (im Acceptance inepection) 
judgment of, from a sample or samples (s«« 
Acceptance oriterion; Acceptance inspec- 
tion) 

quality of, choice of etandards for. 4^49 
cpecification of (sec Lot. sccepubility of) 
rejection of, meaoiog of, 13, 14 
submitted, probability of acceptance (sec 
Opersting.characterisiic curve) 
variation of, from item to item, 8 
Lot tolerance percent defective (LTPD; pt), defi- 
• nicion of, a, 223 

difference between true and intended, in varia- 
bles inspection for fraction defective, 21-26 
causes of, 21, 22 
discussion of. 21, 22, 25, 26 
table showing, 22-25 
selection of, considerations in, 45— 19 
r.owan, Arnold N., x 

(Set afso Methematical Tables Project) 
LTPD (aeeLot tolerance percent defective) 

M 

.V/.’ minimiim value of a measured quality ebarec- 
terietic, below which an item is defective, 13 
m; two-point estimate of p based on probit data. 
350 

formula for, 350 
variance of, 35l 

with optimum arraugement, 352 
Marginal totals, held fixed in analysis of 2 X 2 
table, 251 
Martin, Celia S., x 

Massachusetts Institute of Technology, ix 


Mathematical Tables Project, x, lOn., 31n., 8dn., 
93. 108, 109, 200JI,. 210fl.. 222, 255n., 260n., 
263 

Mather, K., 414n. 

Matrices, numerical inversion of, 172-173 
Alaximum of s fuoction, 365 

design of experiments for determining. 363-372 
factorial, 366. 367, 369-372 
when form of function is known. 371 
aequential, 367-372 
single aample, reference to, 365n., 372 
use of preliminary sample in, 371 
Mean, arithmetic (eee Arithmetic mean, Sample 
mean) 

of binomial distribution, 397, 410 
of grouped distribution, 193, 194 
of lot (p), as measure of lot quality, 6, 27, 28. 
61-63 

of normal diatriburinn, 9. 12, 61, 07, 161, 197, 
198, 342. 378, 423 

variance of maximum likeUhood estimator 
of, when data are grouped, 197 
of Poisson distribution, 41h 
of population (p). bias of sample mesn as 
estimator of, when data are grouped or 
rounded. 187, 189. 212, 213 
confidence limits for. o known, 197, 198 
e unknown, 99, 200-203, 213-215 
decisions regarding, based on sign of differ- 
ence between sample means, 377-382 
eeliisatioD of, by sample mean, 162, 187, 188, 
192, 196-198, 203, 212. 213 
from observations on cumulative distribu- 
tion, 312-352 

optimuni design uf experiments for, 
345, 346. 349-356 

importance of distioguishlng from sample 
mean (i), 12 
as parameter, 12, 161 

tests of significanro rcgaiding, sequential, v 
known, 423 

V unknown, 83-85. 429 
single sample, v known, 61, 62 

when data are grouped or rounded, 
197, 198, 212, 213 

V unknown, 61-63, 71-73 

when data are grouped or rounded, 
200-203 

variance of maximum likelihood estimator of, 
when data are gTOUi>ed or loundwl, 197 
of r. 413 
of s, 58 
of s*. 192. 412 

when data are grouped or rounded, 199, 212, 
213 

of sample, as estimator of po]>ulation mean, 12, 
162. 187. 188. 192, 190-198. 203, 212, 2)3 
bias of, when data are grouped or rounded, 
187, 188, 203, 212, 213 
{See olee Expected value) 

Mean deviation (mean absolute deviation), 
definition of. 162 
as estimator of a, 162, 1C3, 169 
Mean error (see Mean deviation) 
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Norm&l distribulion, basis Iot “probite," 343 
bias of mean deviation aa estimator of standard 
deviation of, 169n. 

bias of 8 as estimator of standard deviation of, 

58, 182 

adjustment factor, formula for, 58 
tables of, references to, 58n. 
bias of as estimator of variance ol, when data 
are grouped or rounded. 199 • 
in biological assay, 342 
bivariate, 146 

conelalion coefficient nl, 413 
relation of T to exponent of, 114—115 
characteristics of, 9-13, 97, 98, 161— 163. 198, 
199, 200, 202, 221, 229, 312. 378, 379. 381 
cumulative, estimating ti and tr {toto data on. 
339-352 

optimum design of experiments for, 345, 34C, 
349-352 

departures from, eeriouaness of, in statistical 
analysea, 49, 50. 99. 198, 199. 202. .346. 
377, 381 

dependence of proportion exceeding given 
limit on the parameters of, 10 
(Se« also Normal deviates) 
in dusage-mortality studies, 542 
of errors of tabular values, advantages that 
would accrue from, 221 
estimation of the parameters of, 12, 58. 161- 
163, 169 

from grouped or rounded data. 197, 188. 
196-203, 312-214 

from observations on cumulative distnbu* 

tlon, 339-352 

expected value, of mean deviation in large 
samples from, 109 

of s in samples from, formula for, 58 
of i + its in samples from, 58 
figure, schematic, 10 
formula for, 161. 423 

for partial integral of, 17, 18, 31. 260. 263 
generaliied, 197 
(8ss also Gram-CharUer series) 
grouped, distribution of s> in samples from, 
J98-200, 203-214 

of i in samples from, 200-203, 214, 215 
of i in saraples from, 19()-198, 203, 212, 213 
independence of I and s> in samples from, 200 
effect of grouping on, 187, 188, 201 
kUTtOsis, measured by or yj, 197, 198 

of distribution of means from, when data are 
grouped or rounded, 197, 198 
mean of (m). 9-12, 61, 97, 161, 162, 197, 198, 
342, 378, 423 

estimation of, from observations on cuinula* 
tive distribution, 342-352 
from probit data. 342-352 
by sample mean, 1G2, 187, 188, 192. 196- 
198, 203. 212, 213 
by sample median, 1G2 
tests of BiKnifiCBnce regarding, sequential, v 
known, 423 

« uskDOw, 83-85, 426 


Normal distribution, mean of (m)i test of signifi- 
cance regarding, single-sample, «• known, 
61. 62. 197, 198. 212, 213 
<r unknown, 61-03, 71-73, 200-203 
variance of maximum likebood estimator of. 
when data are grouped or rounded, 1U7 
parameters of, estimation of (gee Normal distri- 
butiun, estirnation of parameters of ; mean 
of; standard deviation of; variance oi) 
noiatian for, emphasizing distinction from 
sample estimates, 12 

tests of (eee Normal distribution, tests of 
significance regarding parameters ui , mean 
of; standard deviation of; variance of) 
range in samples of k, cumulative distribution, 
figure showing, 230 
tables o(, references to, 229, 230, 234 
distribution of, 234 

dcpenila only on k and cr, 229 
as estimator of e, 227 
mean values of, 227 r., 234 
Standard deviation of, 227n., 234 
standard deviation of (s), 9-12, 97, 161, 229. 
342, 426 

estimation of. from mean deviation, 162. 163, 
169 

from observations on cumulative distribu- 
tion. 342-352 
from probit data. 342-353 
from range, 227 
from s. 1 2. 58 

<8«sait>o Normal distribution, variance 
of) 

teats of eignificance regarding, sequential, 
232. 233. 426 

ein^n-^TOvU, 200, 231, 270, 271, 274. 275, 
278-280 

standard devislion of « in samples from, 58 
of * + fc» in samples iroTn, 58 
tables of, 18 , 31 

need for care in using, lOn- 

references to. lOn.. 18. 31, 148n., 149 b., 343r. 

types of, lOn. 

tests of significance regarding parameters of, 
sequential, 83-85, 232, 233, 423, 426 
single-sample. 61-6.3, 71-73, 197, 198, 200- 
203. 212, 213, 231, 270, 271, 274, 275. 
278-280 

(See also Normal distribution, mean of; 
standard deviation of; variance oi) 
variance of. 161, 198, 199, 200, 212-214 
definition of, 161 

estimatioD of, by mean deviation, 162, 163, 
169 

by **. 182, 108-200, 203-214 
tests of significance regarding, eequential, 
232. 233, 426 

mngle sainpie, 200, 231, 270, 271, 274, 
275, 278-280, 282, 283, 296 
(5e4 also Norma] distribution, standard devi- 
ation of) 

Normal inspection, 43-45 

acceptable-quality level for, choice of, 45-49 
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Normal law {see Normal diatribution) 

Normal'probability function, tables of, lOn., 18, 
31, 148n.-1407»., 343n. , 

need for care in iiaing, lOn. 
types of, lOn. 

Normal-probability paper, 414 

Normal surface (see Normal distribution, bivari- 
ate) 

Normality aaaumptioii, avoided by use of attri- 
butes inspection, 8, 229n. 
by use of distribution-free tolerance limits, . 
90, 109 

dependence upon, of analysis of probit data, 346 
of moments of (-distribution, 201 
of OC curve tor variables inspection plan for 
fraction defective, 49, 50 

of tolerance-liziub factor K, 09 

of f 1 — 2 i as best decision function reearding 
sii^ of jii ~ ^*1 381 

importance of. in air testing of bombsiKbts, 146 
in analysis of sensitivity dsla, 346 
in evaluating probability that sample ineuns 
will he in opposite order to population 
mcaoB, 377, 378 
In setting tolerance limits, 99 
in variables inspection fot fraction defective. 
49, 50 

use of, when severity of any one test cannot be 
controlled precisely, 336 

Normally dulributed test function, derivation of 
critical level (A) and number of obeervations 
needed (N) for, 61. 62 

Notation, as means of emphieiziug distinction 
between parameters of population and 
sample estimates of these, 12 
ueed in variables inspection for fraction defec- 
tive. 85-96 

Nuieance parametere, 115 
^ Null hypothesis, 420 

in analyeis of variance, 311, 312 
in mean tests, 386, 423 

in proportion tests, 249, 251, 264, 357. 358, 421, 
424 

in standard deviation or variance tests. 270. 
278, 281, 386, 387, 311, 312 

O 

OC (see Operating Characteristics) 

OC curves (eee Operating-characteristic curves) 

OC surface (see Operating-characteristic surface) 

Office of Scientific Research and Development 
(OSRD), vii 

(See alto National Defense Research Com- 
mittee) 

Omnibus testa, 386 

Old method, process, or product compared with 
new, with respect to fraction defective, 
249-264, 424, 425 

with respect to level of performance, 59-63, 
380 

with respect to variability of performance, 
280. 282, 283, 296 
(See also Standard) 


One-decision sequential binomial test, 358 
One-sided criteria, use of a pair of, in variables 
inspection for fraction defective, 53, 64 
compared to use of a single two-sided criterion, 
52, SC 

figure showing acceptance and rejection regions 
in (i. s)-plaii<*, 55 

One-sided or one-lail testa, of statistical hy- 
potheses, 52-67, 150, 152, 156, 426 
Operating cbaracteristies (OC), 15, 16, 28-32, 
2C1-2C3. 27i, 278 

Jefinilion of, 14, 261, 271 
Operating-characteristic curves (OC curves), 15, 
29. 234. 263, 274, 275, 296, 297, 379 
lor analysis-oi-variance tests, 313, 314 
for attributes inspection, sequential sampling, 
426, 427 

single sample, 2C0n., 262, 263 
when averages in samples of n determine lot 
quality. 48 

for binomial test, one-decision (Aa)> sequential, 
358 

one-sided, sequential. 426, 427 
single sample, 260n., 262, 2C3 
truncated, sequential, 361 
for x^teat of variaTics estimais [Lp,Lo), 231, 
232. 271-279, 315, 318n. 
figures showing, 274, 275, 315n. 
large-sample formula for, 232 
tables for eonslruciing, 272. 273, 276, 277 
when decisions are based on signs of differences 
between saicpls meons [P(4,Ar}], 378-380 
figure ahowing, 379 
table for constructing. 378 
•lefinilion, 15, 16. 28, 41, 42. 232. 278, 358, 427 
detailed, for singls-aample variables inspection 
plan for fraction defective, determining, 
30-33 

determines what fraction of production sub- 
mitted will be accepted, 47 
as determining factor in cost of quality, 46 
for difference of meaus test, v known, 61, 62 
V unknown. 30, 59-61. 62, 63, 71-73, 76, 77, 
80 

for difference of proportions teat, sequential, 
424. 426, 427 

single sample (Lr). 262, 263 
figure showing, 202 

for double-dichotomy test, sequential, 424, 426, 
427 

single-sample (Lr), 2C2, 263 
figure ahowing, 202 

for double-sampling plans, reference to, 238 
effects of changes in acceptance criterion on, 
21, 45 

of changes in sample else, 21, 45 
of reduced inspection, 45 
of simultaneous use of several acceptance- 
rejection criteria, 60-52, 113, 114 
of tightened inspection, 45 
for experiments for determining whether 
fraction defective of one process or product 
exceeds another, sequential, 424, 420, 
427 
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Opeiating-characterifilic curves (OC curves), for 
experlmenla Icjr determining whether 
fraction defective of one process or 
product exceeds another, si nsle-sample 
(Lr), 282, 263 
figure showing, 262 

whether fevcf of performance of one process 
or product exceeds another, 30, 50-63, 
71'73, 76. 77, 80 

whether variability of performance of one 
process or product exceeds another CL^), 
281-283, 298, 316, 317, 3iaa. 
figures showing, 296, 267, 378n. 
tables for constructing, 284-295, 298-309 
whether variability of performance of one 
process or product exceeds standard 
{Lfi.Lo), sequential, 233 
single sample, 231, 232. 27J-278. 315, 
3l8a. 

figures showing, 234, 274, 275. 3l5n. 
Urge-sample foitnula fur, 232 
tables fur conatruuting. 272, 273, 276. 
277 

whether variability of perfonuance of one 
process or product is leas than standard, 
279 

for F-tosta of variance esUmstee 281, 283. 
296, 313. 314, 316, 317. 3l8n. 
figures showing. 296, 297, 3l8n. 
tables for constructing, 284-299, 298-309 
figures showing, 15. 29, 234. 203. 274. 275, 296. 
297; 379 

references to, 238n., 3l8». 
five-point, 28-30, 427 
figure showing, 29 

for fraction defective testa feee Operating-char- 
BCterUtics curves, attributes inspection: 
variables inspection) 

(or general one-parameter testa, sequential 
(/,«, 426-427 
single sample, 81, 62 

information provided by, 15, 18, 28 , 41. 42, 278. 
358, 427 

interpretation of. 15, 10, 23, 41, 42, 232, 278. 
358r427 

location of, 21, 45 

for mean test, single sample, tr known, 31, 62 
<r unknown, 30. 59-63, 71-73. 76. 77. 80 
of multiple-sampling plans, references to. 238 
steps in computation of, outlined, 361 
for one-decision sequential binomial lest {R,), 
formula for, 358 

ordinate of, 15, 16, 28, 41, 42, 232, 278. 358, 427 
for proportion t»t, sequential sampling, 42C, 
427 

single sample, 260n., 262, 263 
when range in samples of k determinee lot 
quality (iipXv), sequential sampling, 233 
figure showing, 234 

single sample. 231, 232, 271-278, 279. 315, 
318n. 

figures showing. 274, 275, 315n. 
for sequential-sampling plans, 233, 358, 361, 
426, 427 


Operating-characteristic curves (OC curves), tor 
sequeutial-sampluig plans, general proce- 
dure for constructing one-parameter tests 
. ILg). 426. 427 
five-pofot, 427 

for one-decision tests (Ar), 358 

for specific tests (>ee the test concerned) 

(or truncated tests, outline of steps (or com- 
puting, 361 

when several acceptance-rejection criteria aie 
used simultaneously, 50-52, 1]3, 114 
for aiagle-aample inspeetion plans and teats' (see 
lh« test concerned) 

as specification of what will be accepted, 46 
for standard deviation tests , sequer- 

ual, 233 

figure showing, 234 

aiogls sample, 231, 232, 271-278, 279, 291- 
283. 296. 315-317, 3lSa. 
figures showing, 274, 275, 296, 297, 3I6n. 
iarge-eample formula for, 232 
tables for constructing, 272, 273, 276, 277, 
284-296. 29&-30(> 
eteepneas of, 21, 45 
typical, figure showing, 15 

when upper and Tower limits are imposed on a 
aingte quality cbaractoHstie, 52 
use of. to determine w hat fraet ion of production 
submitted will be accepted, 47 
use in selecting plan of aciioo. 15 
for variables inspection plans for fraction defec- 
tive. 15. 16, 2J, 28-33, 4i, 42, 46-50, 52, 
65, 66, 71-73, 70. 77. 89 
when averages in samples of n determine lot 
quality, 48 

computation of, from largs-sampls formula, 
30-33 

from non-centrs] I distribution, 71-73, 76, 
77.80 

dependence on normality assumplion, 49, 50 
effect of changes in or k on, 21, 45 
figure showing, 29 
largo«smple formula for, 30 
plotted as function of K ^ {U — M)/e, 49 
Operating-characteristic surface, 16, 52, 261, 262 
Order of sample means, number of observations 
needed when decisions are based on, 380, 381 
optimum decision function, 381, 382 
probability opposite to population means, 377- 
380 

figure showing, 379 
formula for, 379 
table giving, 378 
Ordered magnitudes, 367, 368n. 

Ore, Oystein, 195n., 196n., 222 
Origin, shifting, to simplify graphical procedure 
for variables inspection, 36, 37, 41, 54 , 69-71 
/ 

P 

P: parameter of binomial distribution, 250, 251 
P: proportion of items with given attribute in 
iiifinite population, 255, 256, 397, 410 
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P\ proportion of population or lot to be included 
between tolerance liiuite, 47r(., dS, 99 
P: true long-mo probability of “eueeeaB’' in any 
elnsle trial. 250, 251 
(See also p) 

Pg: value of P for eyoerimentnl or new method, 
proceea, or product, 259 

Te: value of P for standard or old method, proceea, 
or pr<>duct, 259 

Ft: probability’ or probability deosit)' e©rreei>o«d- 
ing to obeervationa in hand, if null hyp{>th«»- 
ais is true. 420 

aa denominator of lilcelibood ratio, 420 
use of logarithm of, to aimidif}’ aequentiel 
analysis, 421 

Pi', probability or probability denaity correepoud- 
ing to observations in hand, if alternative 
hypothesis u true, 420 
as numerator of likelihood ratio, 420 
use of logarilbin of, to simplify sequential 
analysis, 421 

Pli.S)'' probability sample meatM based on Af 
observations will be in opposite order to 
population means when latter differ by < 
standard dsviatioa units, 378, 379 
figur^showing, 373 
table of, 379 

PA; process overage percent defective. 42 
■p: fraction defective in lot, 15 
p: observed proportion, 355, 397, 419 
p: parameter of binomial distribution. 421 
p; true long-run propocwon of "successear with a 
given method, 421 

p(_a: the fraction defeciive for which the prob- 
ability of acceptance ia 1 — « with a given 
sampling plan, 82 

pg; the fraction defective for wldch the probability 
of aoceptaoce is with a given samplijig plan, 
82 

pt: observed proportion ofsucccwes witheaperi- 
tnencal method, 235 

pa: observed proportion of successes with stand- 
ard method, 256 
p«: iodiffei'Cnce quality, ZO, 29 
pg: value of p when null hypothesis is true, 421 
pi: acceptable-quality level, 16, 229. 357, 359 
{See aleo Acceptable-quality level) 

Pi : value of p for first of two oiethods. rr^KJesees or 
> products, 424 

pi: value of p when hypothesis alternative to 
p “ pg is true, 421 

pi: lot tolerance percent detective, J6, 229, 357, 
339 

(See also Lot tolerance percent defective) 
pi; value of p for second of two methods, 424 
p'; fraction defective for which probability of 
acceptance is 1 — i»s, 32 
I’airman, Eleanor, 104n., 222 
Parameter, of binomial distribution (P,pl. 250, 
251, 421 

of Poisson distribution, 411, 426 
of population, distinguished from staUstic and 
eample estimate, 12 , 161 
Park, R. H., 335n, 


Paulson, Edward, ix, xi, 99, 109 , 248, 393 , 394, 
419n. 

Peach, Paul, 48n., 93 
Pearee, G. R., t94n., 223 

Pearson, Egon Sharpe, 166n., 184, 229, 230, 234, 
27Iii.. 318. 335«., 386n,, 389n., 303. 394 
qiioistion from article by, on "omnibus" tests, 
386 

quotation from letter of, on accuracy of con- 
fidence belt charts, 335 
Peareon. Karl. l94/i.. 222, 223 
Pegram, George B., x 
I’eiser, A. M., I49n., 184 
Pcrceni defective (ses Praction defective) 
Percentage points of statistical test functions (eee 
Bignificaoce levels) 

Percentages (see Proportions) 
w: mneforme<l proportion, 398. 399 

(■See aiao Inverse-sine transformation) 
ys; transformsd proportion with Bartlett's 
adjustment, 401 

(Sea olso Bartlett’s adiustment; Inverse-sine 
transformation) 

the ratio of two variances 281 

formula lor, 283 
detivaUoD of, 28ln., 316, 317 
special case# of, 282 
Ublej of. 284-295, 298-SOO 
r; ratio of circumfereoce of a circle to i ts diameter, 
189 

value correct to 20 deciina) plaesa, 180n. 
value expressed as eoromon fraction, oorreci to 
6 decimals. 189n. 

Pitman, E. ). G.. 386n., 301 
I'lao of action, of an acceptaoee inspection plan, 
definition of. 13 

for locating maxinium oi a function, sequential 
procedure for, 367—369 
suitability of, shown by OC curve, 15 
for variables inspection for fracUon defective, 
outline of. 14 

procedures for, 16-21, 33-41 
Planning experiments, 345-372 (see Design of 
experiments) 

Plana for experiments (see Experiment denignx) 
Poisson distribution or series, relation of partial 
sum to percentage points of x’, 109 
mean, variance, third and fourth momcntB of. 

411 

sequcritia] procedure (or tcsting'paranieter of, 
426 

tables of, reference to, 199 

transformation of, to stabilise variance, deriva- 
tion of. 411, 412 

(See atea Square-root iransformatioo) 
Population, or universe, 12, 9S, 227, 251, 341, 355, 
377 

(See alto Lot) 

l\ipulation mean 12 , 16L 

(^reofso Confidence limits, for Estimation, 
of population mean; Mean, of population; 
Statistical testa, relating to population 
mean) 
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Population proportion 2S5-266, 397, 410 

(See olao Binomial diatribution, parameter of; 
Confidence belts; Confidence intervals; 
Confidence Umita; Eatimation; Prc^ortion, 
population; Staliatieal tests) 

Population standard deviation (e), 12, 161 

(See alao Confidence tinute; Eetimation; 
Standard deviation, of population; Btatia- 
tical tests) 

Population variance (<r*), 12, 161 

(See also Confidence limita; ^timation; 
Btatistical teets; Variance, population) 
Power (unction, of a atatiatical test procedure, 427 
(See olao Operating-characteristic curves. 
Operating-characteristic surface) 

Precision (see Standard deviation; Variance) 
Preliminary sample, use of, in auiibutca Inspec- 
tion when severi ty of any one lest cannot he 
controlled precisely, 336-338 
in planning regression studies, when coat of 
each measurement depends upon its 
magnitude, 321-328 

in planning sensitivity teets, 34S, 346. 349- 
352 

Preliminary trial of an examination, evaluating, 
280 

Princeton University, ix 
Probabilities, compounding, 107 
Probability, absolute, 251 
of accepUnce, 15. 16, 28-33, 41. 42. 45, 56-52. 
232, 233, 201-263, 271, 278, 279, 282. 315- 
317, 358. 361. 427, 428 
(St4 also Operating cbaracteristice; Operat- 
ing-characteristic curves; Operating- 
characteristic surfnes) 

effect upon, of changes in acceptance cri- 
terion, 21, 45 

of changes in sample sixe, 21, 45 
o( reduced iuspecUon, 45 
of simultaneous use of several acceptance 
critsriA. 56-52, 113. 114 
of tightened inspection, 45 
evaluation of (ses Lp; L^; Lpi La:LT;P(S,N): 
Computation, of OC curve) 
conditional, 251 

density or density function, 83. 155, 161, 193- 
195. 217, 270, 281, 342, 392 
definition of, 193n. 

distributions, 10, 61, 62, 72, 73. 99. 109, 114. 
154, 155, 193-195, 197-109, 202, 214, 215. 
229, 230, 251, 270, 281, 342, 392 
element of, 155, 161 

(See also Probability, density) 
function of (fee Probability, distributions) 
that gun barrel will be proofed, 332 
paper, arithmetic normal, 414 
binomial, 414n. 

that proximity fuze will operate, 342 
that sample means will be in opposite order to 
poiiulation means, 378-380 
Probability -wise interpolation, 3l6n.. 318 
Probits, analysis of data expressed os, 342-344 
definition of, 343 

estimation of n and v from, 343, 350 


I’lobits, experiments leading to data expressed 
as, 341, 342 

optimum design of, 345-346, 349-352 
relation to normal deviates, 343 
tables of, references to, 343n., 352 
variance of. formula for, 350 
Process, average (see Process aveiage percent 
defective) 

new (see New method) 
old (see Old method) 

quality level of (see Process average percent 

defective) 

standard (tee Standard method) 

Procesa average percent defective (PA), 42-45 
coniputation of confidence interval for. from 
attributes data, 333-336 
from variables data. 42-45 
as criterioD for determining whetlier to main- 
tainorchange volume of inspection, 42 
example of. 44 

estimation of. from attributes data, 333-336 
from variables data. 42—45 
Procesa control, contrasted with acceptance 
inspectioD. 156, 157 
importance of £ and « in, 34 
(See also Quality control) 

Producer’s risk (<r), conventional value of (5%), 
45n. 

definition of, 16, 226, 229 
maximum of, witVi variables inspection plans 
for fraction defective, 10, 17 
selection of, factors to consider in. 45-49 
Product, new (tee New method) 
old <see Old method) 

Product-moment coefficient of correlation, 413 
Production poesibilitiee, analysis of, 46, 47 
Proof tenting, statistical aspects of. 331-338 
Proofing gun burreb, 331-338 
Proportions or percentages, 15, 47n., 08, 90, 250, 
251. 255, 256. 259, 397, 4 10, 421. 424 
ASN curve for sequential one-sided teat of, 
figures showing, 240, 242 
formula for, 427, 428 

confidence limits for (see Proportions, popula- 
tion) 

estimation of (see Proiiortions, population) 
expected value of, 397, 410 
experiments for comparing two, analysis of 
data from, 249-258. 424, 425 
approximate single-suimplp nietlind, bssrri 
on binomial test, 249, 250, 255 
baaed on xc, 253—255, 245-257 
based on inverse-aine Iransformatiun, 
257. 258, 263, 264 

based on normal deviates, 253—257, 263 
“exact" single-sample method, 250-253 
by Fulcher-Zubin Item Analyser, 257, 
257 r.. 258 

incorrect method for, 256 
nomograph for, Zubin's, references to, 398. 
4L6 

by sequential analysis, 424, 425 
design of, 256-265, 424, 426-428 
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Proportions or percentages, experiments for coin- 
paring two, inverBS>sine transformation of 
data from, 237, 268, 263, 204, 397-408 
number of observations needed, with sequen- 
tial sampling. 424, 427, 428 
with single samples, 258-261, 264 
formula for, 258, 2S9, 264 
nomogram for, 260 
operating eharacteriatlcs of, 2CI 
operating-characteristic curve (OC curve) of, 
determination, by formula, 262 
from nomogram, 263 
figure showing, 262 

operating-characteristic surface (OC surface) 
of, 261, 262 

planning of, 258-265, 424 
sequential, 424, 425, 426-^28 
experiments fur estimating population or true 
(ue Proportions, population) 
experiments for testing a single, analysis of 
data from, 260n., 263. 264. 421, 422 
ASN curves for double, multiple, and sequen- 
tial sampling of, 240, 242 
design of, 259 , 260n., 201-264, 424. 426-428 
inverse-sine transformation of data from, 
397-408 

number of observations needed, with double 
sampling, 237-244 
figures showing, 240-243 
with multiple sampling, 237-244 
* figures showing, 240-213 
with sequential sampling, 26. 237-244, 
419, 420, 427. 428 
figures showing, 240-243 
formula for, 427, 428 

with single sampling, 14, 15, 26-28, 256, 
260n.. 263, 264 
examples, 26 

formula (or, 259, 2C0n., 263, 204 
noiaugiuiii fur, use of. 260 r. 

OC curve of, approximate determioation 
from formula, 260n./ 262 
from nomogram, 260n.. 263 
exact determination of iiointa on, iiRing 
confidence-belt charts, 336n. 
using percentage points of incomplete 
beta (unction. 334, 33Gn. 
planning of. 250, 200n., 261-264, 426-428 
sequential, 421. 422, 427, 428 
one-decision test, 358 
moments of, 410 

population, 15, 47n., 9S, 09, 250, 251, 421 
bins of estimation from vip) and frafp), 403, 
404 

tables showing, 400-402 
estimation of, confidence belts for, 332-335 
confidence Intervals for, based on attri- 
butes Inspection, 332-336 
based on variables inspection, 42-45, 
336n. 

confidence limits for, evaluation from per- 
centage points of incomplete beta 
function, 333, 334, 337 
formula for, 335, 336 


Proportions or percentages, population, esti- 
mation of, experiments for, analysis of 
data from, 832-338 

experiments (or, design of, 238, 333-337 
inverse-sine transformation of data 
from, 336 

number of observations seeded, 333-337 
sequential, 238n. 

included between statistical tolerance 
bmits, 47n., 98-9'J 
standard deviation of, 255, 397, 410 
teats of significance regarding (gee Proportions, 
experiments for. . . .) 

transformation of, to stabilize variance, 257, 
258, 263, 264. 397-408 
(see Inverse-sine transformation) 
variance of, 397, 410 

Protection afforded by aanipling inspection, 46, 
47, 156-168 

Prsyborowski, J., 46n., 03, 255n., 265 
Psychological considerations, 278 

Q 

Quality, acceptable, 61, 228, 229, 269, 278, 270. 
423 

(Set <Utp Acceptable-quality level) 
of accepted lot or product, 16, 41, 42, 46, ISO- 
158 

attainable. 46, 47 
bad (««« Quality, unacceptable) 
choice of standards of, 45-40 
control of (tee Quality control) 

(See olso Control charts; Control limits) 
cost of. OC curve a determining factor in, 46-47 
de^red, 45, 46 

evaluation of (see Quality, of lot; Quality, 
produced by process) 
feasible. 45—47 

good (eee Quality, acceptable) 
high. 42. 43 
improvement of, 40 
information about, 42 

{trovided by procesa average percent defec- 
tive. 43 

by sampling inspection, 156-158 
by statistical tolerance limits, 47, 97—100 
of an item, 7 

of lot, determined by average quality of items 
of lot. 8. 27-28, 61-63 
by dispersion of quality of items of lot, 8, 

27. 28, 229, 269. 270, 278, 279. 280, 283 
by fraction defective, 7, 8 

combinations of m am) v that correspond 
to same fraction defective, 11 
by fraction of averages of samples of n 
that exceed specified limit, 48 
by traction of ranges Hk in samples of k 
that exceed specified limit, 228, 229 
formulation in terms of a, 229-231 
by mean quality (n) in conjunction with 
disF>er8ion of quality (v), 11 
by mean quality (m) of items of lot, 8, 27, 

28. 61-63 
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Qu&lity. of lot, determined by several quality 
uharactcriaiice, 50-02, 113, 114 
by standard deviation (»} of qualities of 
items of lot, 8, 27n., 28n., 229, 269. 
270, 278, 279, 280, 283 
by upper and lovtiet limits on a sdnsle 
quality characteristic, 52-56, 63. 64 
by variability of quality among items of 
lot, 8. 27, 28, 229, 269. 270, 278-280, 283 
evaluation of ft<e Confidenoe intervals; 
Confidence limits; Elatimation; Toler- 
ance limits) 

judgment of, from a sample or samples fse< 
Acceptance criterion; Acceptance in- 
spection) 

submitted, 16, 41, 42, 46, 156-158 
low, 42, 43 
maintenance of, 43 ti. 
measures of («<s Quality, of lot) 
of outgoing product, 16, 41, 42, 46, 150-158 
poor, 42, 43 

produced by process, evaluation of (see Con- 
fidenca intervals; Confidence limits; Esti- 
mation; Process average percent defective; 
Tolerance limits) 

information about, provided by process 
average percent defective, 43 
by sampling inspection, I56-I58 
by statistical tolerance llmils, 47, 97-100 
of a sample, detortnined by sample average. 48 
by sample range, 228, 229 
submitted, 10, 41, 42, 46, 156-158 
unacceptable. 4Sn.. 47-40. 229 
Quality control, applied to air testing of bomb- 
sights. 113-184 

contrasted with ' acceptance inspection, 117. 
150-158 

feature, in procedure for going on reduced 
inspection, 43n. 
functions of, 117 
importance of t and s in, 34 
multivariate. 113-184 

use of a single "‘score” or “indea” in, 113, 
114 

based on generalised Student T, 114-110 
advantages of, 115 
objectives of, 156, 157 

<5«e also Control charts; Control limits) 

n 

Rt : acceptance number for the sample. 237 
(See aleo Rejection number) 

Rk: range of a sample of k items, 229 
(See oleo Range) 

r; observed product-mooieat coefficient of correla- 
tion, 413 

s-transformation of, to stabilixe variance, 
derivation, 413 
Radio proximity fuse, 341 
analysis of test data, method of, 342-344 
design of tests of, optimum, 345-352 
Random selection, of bombsights, reasons for. 158 


Random variation, components of, 269, 297. 310 
311 

estimation of, and teats of hypotheses regard- 
ing, 311-314 

Randomization, methods of, 176, 177 
as precautionary measuTC, 118 

to prevent bias from time trends, 371 
restricted, 177 

role of, in design of experiments, 141, 142, 176, 
177 

Range, calculation of, 227 
definition of, 227 

distribution of, in samples from a normal 
papulation, 234 
cumulative, 229 
figure showing, 230 
tables of, reference to, 229, 234 
rnean of. table, reference to, 227n. 
standard deviation of, 227n. 
as estimator of e, 227 

efllciency of, in small samples from a normal 
population, 237n. 

as measure of dispersion of sample, 227 
reasons for use, 227 

in samples of k, primary cliarsctcrizatiun of lut 
quality. 227, 228 

acceptance inspection when, 227-234 
Range of normal variation, 97 
(Set alto Tolerance limits) 

Rational eentenciiig of lots, 156, 167 
Rectangular distribution, 195, 217, 318 * 

as repreeentation of grouping or rounding 
errors. 195 

for tabular entries, 215-218 
eeini-invarianis of. 195, 190n. 
etandard deviation of. 218 
use of. in ehecking sums and tables, example, 
218 

variance of, 195, 218 
Reduced inspection, 41-45 

ciiteiiun for vimnging to, when lot quality IB 
measured i>y fraction defective, 42 
procedure for judging whether criterion ia 
met, using variables data, 42-45 
when upper and lower limits are imposed 
on a single quality cbaracteristie. 36 
effect of, on OC curve. 45 
luetboda of achieving, with variables inspection 
for fraction defective, 45 
purpose of, 41, 42 

Redundant requirements in specifications, 60n. 
Rees, Mina, z 

Regression analysis, when coat of each measure- 
ment depends upon ita magnitude, 319-328 
when dependent variable is expressed in probits, 
342-344. 349-352 

Rejection criterion, for sequential likelihood ratio 
testa, 420, 421 

for eequential variables inspection for fraction 
defective, 83, 85 

for sin^e-aample tests (»m Acceptance criterion) 
(Seealto Rejection line; Rejection number) 
Rejection line. 232, 357-860, 422, 423, 425 

adjusting, to allow for acceptance line, 358-360 
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Rejection linOt figure showins, 3S7 

for number of "eucceseea" in binomial teat, 422 
for number of "success-failure'' pairs, ia double- 
dichotomy test, 425 
for one-dcciaion bmomial test, 35S 
for Bum of obeervationjs, in teat for>>, « Icnovn, 
423 

for sum of squared observations, in test tor^, n 
unknown, 232 

Iteiection number (fi*. Si), 237, 239, 244. 358, 
422, 425 

definition of (Ak), 237 
in double sampling, 237 
examples, 230, 244 
in multiple sampling, 237 
examples, 230, 244 

relation to acceptance number (its) charao- 
terizes type of sampling plan, 237 
in sequential sampling (Ak), 237 
in sequential testa (Si), 422, 425 
in sequential testa that provide for rejecilon 
only. 358 

in single sampling, 237, 300n., 263, 2fi4 
Reieotion region, boundaries of, for sequential 
testa (tea Rejection line) 
for emgle-sample tests (see Acceptance region, 
boundaries of) 

Relationship, determining, when cost of each meas- 
urement deponds upon its magnitude. 319-328 
Replication, dual role of, in experimentation. 159 
p; product-moment cocIScient of correlation in 
normal bivariate population, 413 
p: ratio of population variances (^iVoo*). 271 
p(<(,^,ni)> definition of, 27i 

Urge-sample formula for, 278n. 

UbJes of, 272, 273, 27fl, 277 
use of, examples of, 271, 274, 275, 278 
p’ (a,g,ni), definition of, 279 
relation to p(<i.^,flt), 279 
use of, example of, 280 
Rider, Faut R., 386n., 394 
Rietz, Henry Lewis, I96n., 197n„ 2l8n., 223 
Risks, in use uf sampling inspection, 150, 157 

(See alto Consumer's risk; Operating-char-' 
acteristic curves; Producer's risk) 

Robbins, Herbert, 109 

RoHermnnd, Kdythe B., t 

Romig, Harry G., 27n., 93 

Rounded numbers, impossibility of avoiding use 
of, 188. 169 • 

measurements as, 187—189 
scale readings as, 188, 189 
tabular entries as, 191, 215-218, 221 
Hounding, 187-223 

accepted procedure for, 169, 100 
(See also Rounding Rule) 

Cayley's procedure for, 191 
effect of, on descriptive statistics, 187, 188 
on distribution of error of an interpolated 
value, 221 
of F. 214, 316 
of a*, 198-200, 203-214 
of Student’s 1. 200-203, 214, 215 
of £. 196, 198, 212, 213 


Rounding, effect of. on moments of probability 
distributions, 193-196 
representation as effect of random 
"errors," 195 

on standard procedures for statistical infer- 
ence, 191-215 

impossibility of avoiding, 188, 189 

reasons for, 187—189 

repeated, consequences of, 190. 191 

(Set also Rounding interval; Hounding lat- 
tice; Rounding rule; Sheppard’s correc- 
tions) 

Rounding interval, recommended size of, 192, 214 
reasons for, 214 

Rounding lattice, effect of position of, on din- 
tribution of s', 206-213 
on distribution of i. 212, 213 
random location of, 194 

extends validity of Pheppord's corrections, 
196 

procedure for, when only non-negative values 
occur in population, 190 
Rounding rule. 189, 190 
Cayley’s form of, 191 
effect of repestod applications of, 190, 191 
elementary properties of, 190, 191 
importance of adhering to, 190 
Roy. S. N.. 184 
Royalties, vii 

6 

S: sensitivity of a fuse, 342 
s: sample eetimate of population standard devia- 
tion (a\, based on sum of squared devla- 
tionafromeamplomean, 12,13,162,192 
adjustment of. 58 

advantages of, relative to n^ean devlatjon, 162 , 
163 

relative to sample range, 227s. 
association of values of. with values of £, when 
data are grouped ur rounded, 187, 188 
bias of. 58 

adjustment (actor, formula for, 58 
tables of, references to, 58n. 
when computed from grouped or rounded 
data (see «') 

combining valuce of, to estimate variability of 
process, 42—43 

computation of, 12. 13, 33. 34, 42. 4.3, 162. 192 
/f — I vereu* in, 18, 68 
naive procedure for, criticism of, 33 
using modern computing machines, 33, 34 
defiiution of, 12. 13, 162, 192 
^7 — I versus N in, 13, 58 
degrees of freedom of, 18, 1.3, 43 
(See alto s', degrees of freedom of) 
division by, in computing, 12. 13, 43 
as denominator of Student's (, 72, 200 

Sheppard’s corrections not to be used for, 20S 
design of experitnents for testing, 2G9—290 
distribution of, approximately normal for large 
N, 58 
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*' sample eatimate of population standard devils 
Lion (tf), distribution of, mean of, for- 
mula for, 5S 

tables of, refetenees to. 58n. 
standard deviation of, formula for, 5$ 
tables of, references to, S8n. 

(See aleo s’, distribution of) 
effect of grouping or rounding of data on (aeea*) 
efficiency of, lb2, 227 

expected value of, in normal samples, formula 
for, 58 

tables of, references to, &&n. 
formula for, 12, 13. 43. 162, 192 
grouping of data, effect on, 187, 188 (SeeaUo e*) 
homogeneity of two or more values of, 385-389 
importance of distinguishing from a, 12 
Importance of, in quality eoutro), 34, 42-44 
largest of several values of, testing of, 383-394 
logarithmic transformatioa of, to stabilize 
variance, 412, 413 

mean of, in normal samples, formula for. 58 
* tables of, references to, dSn. 
mulUple of, for setting tolerance limits (sea K> 
used in variables inspection for fraction 
defective (see k) 

^ ' 1 versus S, to definition and computa- 
tion of, 13, 58 

standard deviation of, in normal aamplee, 
formula for, 58 
tables of. refereocee to, 58n. 
termed “aample standard deviation'* for 
brevity, 12, 13 

teste of significance regarding (see «*) 
transfoimation of, to stabilize variance, 412, 
413 

use of, ia acceptance inspection for v. 231. 232, 
270, 271, 278-280 

in acceptance inspection when ranges in 
samples of k determine lot quality, 227- 
234 

in computing control limits for means. 147, 
148 

in estimating process average percent defec- 
tive, 41-44 

oppeeition to, rebuttal of, 33, 34 
in quality control, 34, 42-44, 151, 152 
in setting tolerance limits, 47 
in variables inspection for fraction defective, 
9-14, 33, 34, 41-44, 48, 53, 56, 58-64. TI- 
TS. 83-85 t 

s: sample estimate of population standard devia- 
tion (v). based on cumulative distribution 
(probit data), 343, 350 
variance of, 351 

with optimum experimental design, 352 
i; elope of parallel lines in graphical sequential 
analysis, 232, 233, 3,57, 358, 426, 427 
formula for, binomial test, one-decision, 358 
binomial test, one-sided, 422 
double-dichotomy test, 425 
mean test, v known, 423 
standard deviation teat, p unknown, 233 
use in constructing ASN curve, 233 
five-point, 427 


s: slope of parallel lines, in graphical sequential 
analysis, use in constructing OC ourve, 
233 

five-point, 428 

sg; observed numlicr of "successes" in ^ trials 
with experimental method, 202 
as: observed number of "successes” in N trials 
with standard method. 262 
s^: sample estimate of population variance (s’), 
12-13, 43, 162, 198 

bias of. when computed from grouped or 
founded data, 198-200, 203-2U 
computation of, 12, )S, 33, 34, 42, 43, 1C2, 198 
control limits for, 151 

correlation of, with 2, when computed from 
grouped or rounded data. 1S7, 201 
definition of. 12, 13, 43, 162. 198 
degrees of freedom of. 12. 13, 43. 199, 203, 270. 
312. 387, 388 

design of experiments for determining and 
testing. 269-206 

distribution of. mean of, in sample from arbi- 
trary grouped or rounded populations, 199 
in large samples from arbitrary population, 
199 

effect of grouping ot rounding on, 19^200 
ia aamplee from a normal population, 199, 
270 

effect of grouping or rounding on, in large 
samples, 19^200 
in small samples, 203-214 
variance of, in aamiiiet from arbitrary, 
grouped, and normal populations, 199 
effect oi grouping or rounding of data on, 197, 
188. 198-200, 203-214 
efBcieney of. 162 

eapectsd value of, in eamplcs from arbitrary. 

groiijied, and normal )>opiiLaUons. 199 
formula for, 12, 13. 43, 162, 108 
grouping of data, effect on, 187, 188, 198-200, 
203-214 

homogeneity oi two or more values of, testing 
of. 385-389 

importance of distinguishing from v’, 12 
independent of i in samples from normal 
population, 200 

effect of grouping or rounding on, 187, 188, 
201 

largest of several values of, testing, 383-394 
logarithmic tranaforraatioo of. to stabilize 
variance, 412, 413 

mean of. in samples from arbitrary, grouped, 
and normal populations, 199 
momenta of, in samples from a normal popula- 
tion. 4 12 

tests of significance regarding, sequential, 232. 
233. 426 

'single sample, 231, 232, 260-296, 383-394 
transformation of, to stabilize variance, 412. 413 
uses of, special fase t) 

variance of, in samples from arbitrary popula- 
tion, 199 

when data are grouped or rounded, 199 
in samples from normal population, 199 
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sample estimate of population varianc'e (o-*), 
variance of| in samplea from noririHl popula- 
tion, when data are grouped or rounded, 211 
yardsticks fur, iS2 
Salser, H. 100, 416 
Sample average (see Sample mean) 
as basis for decisions, 1S&-158 

(See alto Consumer's risk; Operating char- 
acteristics; Operating-characteriatic curves; 
Producer’s risk) 
mean (tee Sample mean) 
median (tee Median) 
random, 158-160 
representative, 160 
selection of, 158-160 
size of (tee Sample size) 

Sample mean (f), 12, 43, IGO, 192 

advantages of, relative to sample median, in 
normal Bamples, 161, 162 
bias of, when data are grouped or rounded. 187. 
188, 197. 212 

combining, from several samples, in estimating 
proeess average percent defective, 42, 43 
computation of, 12, 43, 100, 192 
control limits for, 147-150 

correlation of, with s or «*. when data are 
grouped or rounded, 187, 188. 201 
definition of, 13, 43, 100, 192 
as descriptive etaiistic, effect of grouping or 
rounding on, 187-188 

design of esperimcnls for testing. 17. 27 n., 28a.. 

60-66, 81, 82, 377-382, 423 
distribution of, for arbitrary population. 197, 
198 

of grouping or rounding on, lf»6-J9^ 
203 

for normal population, 163 
effect of grouping or rounding on, 187, 188. 196, 
198, 212, 213 

efficiency of, in normal eamples, 163 

when data are grouped or rounded. 197 
os estimator of population mean (>>), arbitrary 
population, 197, 198 

when date are grouped or rounded, 190- 
198, 212, 213 
normal population, 162 
(See also Conhdence limits, for m) 
expected value of, 197, 198, 212. 
importance of distinguishing from population 
mean (><), 12 
mean of, 197, 198, 212 

moments of. in samples from arbitrary, grouped, 
and normal populations, 197, 198 
use in quality control, 34, 43-44, 147—150 
ia variables inspcclion for fraotioo defective, 
9-14, 33, 34, 41-44, 48. 53, 56, 58-64, 
71-73, 83-85 
variance of, 162, 197, 198 
yardsticks for, 150 

Sample mean deviation (see Mean deviation) 
Sample median (see Median) 

Sample size, adjustment of, by modifying OC 
curve, 19 


Sample size, average, 233, 238, 420, 427 
(Sss also ASM curve) 
clionges of, effect on OC curve, 21, 45 
for each of two eamples (see JV. second listing) 
for single sample (see y, first listing) 

(See also Amount of inspection; Computa- 
tion of number of observationa ncc<lcil; 
Formula, lor number of observationa 
needed; fifa, ffm. y„ Ni) 

Sample standard deviation, 13, 13, 187n., 168n, 
(See also s) 

Samples, eombined, 42, 43 
Sampling, biased, 160 
curtailed, 14, 238, 361 

random,- role of, in experimentation, 158-160 
represenlalive, likelihood of bias of, 160 
Sampling inspection, aims of, 17)0-158 
control features of, 42. 43, 157 
effectiveness of, 156-158 

(See also Operating cliaraeteristics; Operat- 
ing-characteristic curves; Operating-char- 
acteristic surface) 
objectivea of. 156-158 
risks involved in, 228, 229 

(See also Consumer’s risk ; Frodueer's risk) 
steps in, 13. 14 

value of, dependent upon quality of submitted 
%roduct. 42 

(See also Acceptance inspection; Inspection) 
8ampling-insi>ection plsns, sitributes (see Attri- 
butca. inspection) 
changes in, 41—15, 142-145 
claasification of, 237 

comparison of. 26-28, 85, 237-244, 410, 420 
doulJtt 237-244 
multiple, 237-244 
multivariate, 111-184 

sequential. 83-85, 232, 233, 358-362, 419-428 
single sample, 7-82, 111-184 , 231. 233. 237, 
249-264. 269-296, 331-338, 377-381, 385- 
393 

(See also Acceptance inspection; Inspentton; 
Statistical testa) 

Savage, Leonard J.. ix, xii, 238n., 244, 354, 364 

Scale reodings, 188, 189 

Scbeff8. Henry, 109 

Schumpeter, Joseph A., 145n., 183 

Scores, examination, dispersion of, 280 

use of, in acceptance inspection and quality 
control, when several quality cliaracter- 
iatics are involved, 50-52, 113-116 
Sealy. E. 11.. 150, 157, 184 
quotation from, 156, 157 
Semi-invarianta, of rectangular distribution, 195, 
I96n. 

Sheppard's corrections for, lOGn., 222 
Sensitivity tests, 341, 342 
analysis of data from, 342-345 
optimum design of, 343, 34G. 349-352 
use of preliminary data iii. 346-349 
Sequential aualysis, 26, 83-85, 232-234, 237-244. 
357-362, 367-372, 417-429 
advantages of. 26. 367-371, 419, 420 
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Sequential analysis, compared with non-eequenlial 
analyeie. 26. 85, 237-244. 367-372, 416, 420 
conditions for superiority of, over non-sc^uen- 
tial analysis, 366, 371, 416, 420 
for superiority of non-Bequential analysis, 
371, 42Q 

definition of, 237, 367, 419 
disadvantagee of, 371 
elements of, 417-429 

Fequential deeigrv, of experiment, for locating 
maximum of a function, 367-372 
when failure rate of equipment, is high, 353- 
362 

Sequential eetiination, of parameter of binomial 
distribution, reference to, 338n. 
Stuue.iitial-8aiupUiig'inHiiec.li'>n plans. 83—65. 232, 
233, 358-362, 421-426 
(See also Statiatical teats, sequential) 
acceptance line, in grophieol procedure for. 
232, 350, 357, 360. SCO, *22, 423. 425 
(See alto Acceptance line) 
acceptance number in, 237, 422, 425 
amount of inspection in, (see Amount of iospeo- 
tlon, -with sequential sampling) « 
operating-characteristic curves of (see Operat- 
ing-cbtiTficteiialic curves) 
that provides for rejection only. 357-302 
rejecUon line, in graphical procedure, 232. 356, 
357. 359. 360. 422, 423. 425 
(See also Rejection line) 
rejection num^r in, 237, 422, 425 
Severity of test, cannot be controlled precisely, 
msiioction for fraction defective when, 
331-333 

Sheppard, W. F.. 188, 193, 196. 197. 109. 263. 223 
Sheppard's corTecliwis, 162-166 
bivariate, references to, I93n. 
conditions for strict validity of, 163 
consequences when not fulfilled. 106 
implications of. 194 

conditions for validity •'on the average," 194- 
196 

when grouping lattice is located at random. 
164-166 

for y-shaped distributions. 194 
references to, 194n., 222 
multivariate, references to, 193a., 223 
pot to be used, in computing confidence limits, 
199, 200, 203 

in evaluating teets of significance, 199, 300, 
203 

Shewhart, Walter A., 47n., 46n., 53n., 63, 97n., 
no, 22U., 223 

Short cuts, in analysis of 2 X 2 table, 253-255 
v: standard deviation of lot of populalion (see 
Standard deviation, ol lot; of population) 
<r(,N): standard deviation of number of items 
inspected, 238 

figures showing, for double-, multiple-, and 
sequential-sampbng plans, 341, 243 
as: standard deviation corresponding to standard 
method, process, or product, 269 
ai: standard deviation corresponding to new 
method, process, or product. 2C6 


ai: Rtandard deviation defining gnnd quality, 
when lot quality is measured by fraction of 
sample ranges that exceed apecifieri limit, 
226-231 

ai ; standnrd deviation of the first of two methods, 
proeeasee. ot products, 290 
standard deviation defining bad quality, 
when lot quality is measured by (raelion of 
sample ranges that exceed specified limit, 
226-231 

standard deviation of the Second of two 

methods, processes, or products, 280 
Significance, statistical tests of (sec Statistical 
testa) 

Significance levels, of Bartlett's test, approxima- 
cion to, 388 

tabiea of, reference to, 388n., 394 
of xt. approximation to, 255 
tables of. reference to, 255 
of X*. Cornish-Fisher type expansion for, refer- 
ence to, 109 

for one degree of freedom, equivalent to Ko', 
258n. 

relation of, to partial sum i>I Poisson series, 
109 

to aignificanee levels o( F-distribution, 316 
tabiea of. references to, 315». 
of Cochran’s test, tables of, 360, 301 
of F, Paulson's approximation to, 393. 394 
for nt • w. equivalent to significance levels 
of X*. 316 

relation of, to percentage points of Fisher'a «, 
317 b. 

of incomplete beta function, 302, 393 
tables of. comments on. I5ln,, lS2n., 317n. 
references to. )31a., 134, 317 r., 313 
Hotelling’s T (tee Significance levels, of T) 
meaning of, 270, 271, 281 

of normal distribution, relation of, to probits, 
343 

short table of, 18 

tables ol. references to, lOn., 18. 343 r. 
need for care in using, lOn. 
of range, in samjiles of k iroin normal distribu- 
tion, curves showing, 230 
table of, reference to, 226rt.. 234 
of T, asymptotic expansion for, l35 

relation of, to significance levels ol x*, 165 
of F, 155 

of (, asymptotic expansion for, 148, li9n., 181 
tables of, references to, 148n. 
of s, relation to significance levels of F, 317n. 
Significant diSerences (ae« Statistical tests) 
Significant figures, 189 
defliiitioD of, 189n. 

recording excessive number of, 191, 192 
^too few. 192 

Simaika, 3. B., 31 Cr., 318 
Simon, Herbert A., 381, 382 

Smultaneity of events, acceptance inspection for, 
227-234 

formulation in terms of <r, 226-231 
measured by fraction of sample ranges that are 
less than specified limit, 227, 228 
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Siagle-aaoipling-inspection plans, 7-$2, IH— 184, 
231, 232, 237, 249-20-1, 269-290. 331-33%, 
377-381, 385-393 

(See also Statistical tests, Rmeie^ample) 
acceptance luimber in, 237, 280 r., 263, 264 
amount of inspection (s«e Amount ot inapeetion, 
with single sample) 
curtailment of, 14, 238 

operating characteristics of (s«e Operating 
characteristics; Operating-eharacteriatie 
curves; Operating-characteristic surface) 
rejection number in, 237, 260n., 263-274 
Skewness, of distribution of t, when data are 
grouped, '■IQS 

measures of 197, 198 

Slope, of linear regression function (8), 322 

determination of, when cost of each measure 
ment depends upon its magnitude, 319-328 
when dependent variable is expressed in 
prohits, 343, 350 
references to, 343n., 352 
relation of, to o, 343 
two-point estimate of, formula tor, 350 
Small samples, effect of grouping or rounding on 
statistical analyses of, 203-215 
eEffeienoy of, as basis tor decisions, 156, 157 
Smith. iB. Babington, 120n., l%4 
Snedscor, George W., 405, 415 
BolomoD. Herbert, ix, 384 
Specifications, inconsistent, 50n., 5in. 

redundant, SOn., 51 r. 

Sponsorship, vii 

Square-root transformation, 411, 414 
Stabilizing ratianoe, by transformation of data, 
40S~414 

Standard; new method, process, or product com* 
pared with, with respect tu fraction defective, 
7-93, 27n., 28fi.. 231-234, 237-244, 270. 271. 
274. 273, 276-280. 428 

with respect to level of performance, 17, 27n.. 
2Srt.. 59-63. 81, 82. 423 

with respect to variability of performance, 
227-234, 270, 271, 274, 275, 278-280 
(See also Old method) 

Standard deviation, of binomial distribution, 255. 
397 

of correlation coefficient («e« Variance) 
of lot (a), as measure of lot quality, 27n., 28n., 
229-231, 209-296 

(See alto Standard deviation, of population) 
□I mean (eee Variance) 
of mean deviation (see Variance) 
of median (see Variance) 

of normal distribution («). 9, 12, 58, 97, 161. 
229, 342, 378, 423, 426 
bias of s as estimator of, 58 

adjustment factor, formula for, 5% 
tables of, references to, 68n. 
as parameter of, 12, 161 

as reciprocal of slope of regreesion line, when 
dependent variable is expressed in proluts, 
343 

of number of items inspected (w(JV)), 238 


Standard deviation, of number of items inspected 
(v(Ar)), rigiircs showing, for double-, multi- 
ple-. and sequential-sampling plans, 241, 243 
of Poisson diatrihution (see Variance) 
pooled estimate of, 43 

of population («), bias of s as estimator of, in 
normal samples, 58 , 

confidence limits for (tse Variance) 
estimation of, from mean deviation, 162, 163, 
169 

from probit data, 342—352 
from range, 227, 227n. 
from «, in normal sampleR, 58 
from senaitivity tests, 342-352 
(See alio Variance) 

importance of distinguishing from «, 12 
aa parameter of normal distribution, 12, 161 , 
tests of sigaidcaace relating to, sequentiat, 
232, 233. 426 

ainglc-saniple, 231, 232. 269-206. 386'3n4 
of proportion or percentage, 255, 307 
of r (tee Variance) 
of range. 227n. 

of rectangular distribution, 218 

of •, in normal samples, formula (or, 58 

of sample, 12. 13. 187n., 188n. 

Standard error (see Biandard deviation) 

Standard method. ]>rocees, or product, compared 
with a new (*e« Old method) 

Stanford University, ix, xi, xil, OC, 384 
Statistical hypothesis, alternative, 419, 420 
null, 420 

under test, 419, 420 

Statistical tlesearch Croup, lii, Iz-xi, 0, 8n,, 20n,, 
2$n., 3in.. 42s.. 52a.. 83a., 85ft., 93, lOJft., 
108n.. lOdn., I43n., 184, 188 , 231n., 234. 
237ft.. 244. 257n,. 26r)n., 335ft., 368n., 36lft . 
362. 400. 405ft.. 415, 419n.. 420n.. 428, 429 
eenior ecienUfic staff of, list of names, ix. x 
Statistical tests, analysis of variance, 312-314, 
385, 386 

for components of variance, 312-314 
(or homogeneity of means, 385, 386 
Bartlett's, for homogeneity of variance estl- 
matea, 183, 385-388 

based on sign of difference between sample 
means, 377—382 

conditions rendering optimal, 381, 382 
bias of, if Sheppard's corrections are used, 199, 
200. 203 

iHnomial diatribution, based on, 249, 250, 255 
for comparing parameters of two, 249-258, 
424, 425 

(or testing parameter of a single, 2C0n., 263, 
264. 421, 422 

with provaion for rejection only, 358 
Xrtest. 264-257 

X^-test, for deciding from ii*. whether vi* > v«>, 
270-278 

(or deciding from si*. whether vi* < vo*, 
278-280 

(or deciding from "sum of equ.ires" whether 
e* > ei». 231, 232 

for homogeneity of proportions, 256, 257 
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Statistieal teats x^teat, (or homogeneity of pro- 
portions, of 2 X 2 table, 254, 255 
of variance eslimatea, 386-388 
Cochran's, for Bignihcance of largest variance 
estimate, 383-394 

for comparing two binomial diatributioris, 249- 
258, 263, 264, 424, 425 
two means, Gl, 62 

two percentages or proportiona, 249-258 

263, 264, 424. 425 

two standard-deviation or variance estimates, 
280-297 

for componenta of variance, 312—314 
curtailed, 14. 238, 361 

for determining whether new method, process, 
or product exceeds a atandard, with respect 
to fraction defective, 7—93, 27i»., 28 b., 
227-234. 237-244, 270. 271, 274, 275, 278- 
280, 421-423 

with respect to level of performance, 17 
27a,. 28a„ 59-63, 81, 82 
with respect to variability of iterfotiiiance. 
227-234. 270, 271, 274. 275, 278-280 
for determining whether a particular one of two 
methods, processea. or products exceeds the 
other, with respect to fraction defoeti%'e. 
249-258. 263, 264, 424. 425 
with respect to level of performance, 59-63. 
380 

with respect to variability of perforinaiice, 
280, 282. 283, 296 
for difTerence of means, 59^3, 380 

of percentages or proportions. 249-258, 263, 

264, 424, 425 

for double dichotomy, 94<^258, 424, 425 
double-saaipLing, for fraction defective, 237-244 
effect of grouping or rounding on, with large 
samples, 191-203 
with small samples, 203-215 
errors of the first and second kinds associated 
with, 271, 281. 282 

/’•test, in analysis of variance, 31 1-314 
for componenta of variance. 31I-3I4 
tor liuiiiogeiieily of means, 385-386 
of ratio of standard deviation or variance 
estimates, 280-296 
for four-fold table, 249-258, 424. 425 
for fraction defective, based on enumeration 
data. 237-244, 249-268, 260n., 263. 264, 
421, 422, 424, 425 

based on measurements, 7—93, 27 b., 28n.. 
227-234, 270, 271, 274, 27 5 278-280, 423 
general one-parameter, sequeutial, 426-428 
single sample, 61, 62 

generalized Student’s ratio (*« Hotelling’s T) 
for generalized variance, reference to, 106 
graphical, 34-37, 52-56, 66-71, 232, 233. 260, 
356-359, 398, 414n., 416, 422, 423, 425 
grouping, effect of, on, with largo aamples, 
191-203 

with small samples, 203, 215 
for homogeneity, of means, 61, 62, 385, 386 
of percentages or proportions, 249—258, 263, 
264, 424, 425 


Statistical tests, for homogeneity, of 2X2 
table, 249-258 

of variance estimates, 385-389 
Hotelling's T. 114-116, I52-I5G 
indifference value in, 282 

for mean, comparison of two or more, S9-G3, 
380, 385, 386 

test of a single, 61-63, 71-73, 83-8.5, 197, 198, 
209-203, 212, 213, 423, 426 
mechanical (see Fulcher-Zobin Item AnalyztT) 
mulliple-aampliug, for fraction defective, 237 
244 

multivariate, 50-52, 114-116, 147-156 
number of observations required (tee N\ 

N.: N»; N.-. Ni) 

(See al»o .Amount of inspection; ASN curve; 
Computation of; Formulas) 
omnibus, 38G 

one-decision sequential binomial test. 358 
one-sided or one-tail, 52, 57, ]50, 152, 156. 420 
oi>erating characteristics »f (seo Operating 
characteristics; Operating-characteristic! 
eurvea;^ Opcratuig-charseteristic surface) 
for order of population means, 377-382 
lilanning (see Design of experiments) 
for proportions or percentages, comparison of 
two, 249-258, 263, 264, 424, 425 
test ofa single, 237-244, 260 b.. 263. 264, 421, 
422 

with provision for rate of failure of equipment, 
355-362 

for range in samples of k, formulation in terms 
of sample "sum of squares,” 229-231 
for ratio of two standard-deviation or variance 
estimates. 280-296 
risks associated with, 271, 261, 282 

(See alto Operating-characteristic curves) 
sequential. 83-85. 232, 233. 358-362, 421-426 

for sign of difference between poiiiiintion 

means,' 377-382 

significance levels of (see Significance levels) 
for etaadard deviations or variances, compari- 
eoa of two or more, 231-233, 269-296, 385- 
394. 426 

r-teat, HotelUng’s. 113-116. 147-156 
(, non-central. 71-73 

Student’s. 72. 147-149, 200-203, 214, 215 
relation of, to Student's z-iest, 200 
twevsided or two-tail, 52-S7, 150. 152, 156, 420 
Iransformaiion of data in, 257-259, 261-264, 
395-416 

truncated. 14, 238, 361 
for variance components, 312-314 
for variances (see Statistical tests, for standard 
deviations) 

Statiatics. sample, contrasted with population 
parameters, 161 
Steffensen, J. F., 221n., 223 
Stigler, George J., ix 

Student (^ilUam Scaly Gosset), 187, 200, 201, 
203, 223 

quotation from, 187. 188 
Student'a t, definition of. 72, 200 
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Studeot'a I, diatributioa of, effect of grouping or 
rounding on, with large aamplee, 200-203 
with email samples, I67, 1S8, 214. 215 
percentage points of, asymptotic eapansions for, 
148, 149n., 184 
tables of, references to, I48n. 
relation of, to Sludent'a 2 . 200 
Sheppard's corrections not to be used in com- 
puting, 203 

Student's 2, definition of, l87n. 

effect of grouping on, 187, 188 {Ste at»o 
Student’s t) 

relation of, to Student's (, 200 
Systematic variation, 310, 311 

T 

T; angular difference between two binomial 
probabilities Pi and Ps, 202, 204 
T: generic symbol for an estimator of a parameter 
6. 4C)S 

T*; IloteDhig'e generalised Student ratiu, deCoition 
of, 142, ISi, 153 
distribution of, 154, 155 
asymptotic expansion for percentage points 
of, IS5 

free from nuisance parameters, 115 
relation to x*’di8tribuiiQn. 155 
to F-ilialrihution, 155 
optimum properties of, 147 
as "score." combining results of two or more 
tests, U3>ne 

T: Zubin's symbol (or a transformed I'roportiun. 
405, 415 

T-statistles. advantages of, 115. 164 
applied to air testing of bombsigiita, 122-142, 
104-168 

control charts lor, figurea showing. 132. 134, 130 
control limits (or, computation of, 152-155 
deffnitiuna of. and relatiunahips, i3l, 133. 153, 
154 

distributions of, 152-153, 164 
uses of, 1 15 

yardsticks for, computation of, lfi6 
f: angular difference between two observed pro- 
portions ps and pj, 204 

1; ratio of a normally distributed variable to an 
independent estimate of its standard 
deviation, 72, 73 

fSes also Student’s t; Kon-centrai /) 

( 0 : Johnson and Welch notation fur a given level 
of non-central 1, 73 
Tables, cbeckiag of, x 

list of principal reference, xiii 
Tabular entries or values, effect of further round- 
ing of, 101 

Fisher- Wishart recommendation regarding, 221 
statistical properties of, 215-218, 221 
Tchebycheff inequality, 40, 221 
0: angle corresponding to an observed propoiUon, 
257, 258, 398, 400 

0: generic symbol for a parameter of a probalality 
distribution, 408, 426 

0o: value of 0 when null hypothesis is true, 426 


9t: v’alue of 6 when alternative hypothesis is true, 
426 

Thompson. Catherine M., IIO, 15In., I52n., 184, 
315-318, 333. 335rt., 336n., 338, 388n., 303, 
394 

Tightened inspection, 41^5 

criterinn for changing to, when lot, quality is 
measured by fiactum defective, 42 
procedure for judging whether criterion is 
met, using variablca data. 43-45 
when upper and lower limits are imposed 
oa a single quality characteristic, 56 
effect of, on OC curve, 45 

methods of achieving, with variables inspection 
for fraction defective, 46 
purpose of, 41, 42 

Time to rupture, for teat specimens, 321 , 363 
determination of, when cost of each measure- 
ment depends on its magnitude, 822-328 
dcterminatioD of composition yielding maxi- 
mum. 365-372 

'i'ime trends, effect of, on statistical (tnelysea, 371, 
372 

Tippett. L. H. C.. I20n.. 184. 22rn,, 234 

Tolerance factor for normal distribution. 

97-108 

deftnition of. 97, 98 
formulae for. 101 , 108 
table of values of. 102-107 
uses of, examples of, 100, 101 
{S«« o}tt> Tolerance limits) 

Tolerance limits, statistical, 47, 97-108 
conditions for satisfactory use of, 97 
contrasted with eonfidence limits far popula- 
tion mean. 09. 100 
definition of, onesided, 47, 98, 99 
two-aided. 97. 98 
diatnbutiun-fiea, 90, 109 
for non-normal distributiona, 99, 109 
for normal distributions. 47, 97-99, 100-108 
one-sided. 47. 98. D9 
computation of, example, 47 
two-sided, 47 r.. 97-99. 100-108 
examples of, 100, lOl 
factors for, table of, 102—107 
formulas for. 101, 108 

Transformation, angular, 257-259, 261-264, 336, 
395-410 

general, to stabilize variance, 408-410 
inverse hyperbolic tangent, 413 
inverse sine. 257—259. 261-264, 336. 395-416 
logarithmic, of F, 317n. 
of r, 413 
of e or *>, 413 
prubit, 343, 352 
square root, 4(1, 414 
S-, of correlation coefficient (r), 413 
of variance ratio (F), 3l7n. 

Transformed correlation (z), 413 

Transformed percentage or proportion (v’.r,0), 
257, 258, 398, 400, 406. 415 
(See alio Inverse-sine transformation) 

IVendn, effect of, on statistical analyses, 371, 372 

Tukey. John W., 109, 414/). 
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I 

2X2 tabic (see Double dSchoiomy) 

Two-elded etilerion, in variables inepeciiun lor 
fraction defective, S2-S7, 63, 64 
Two-sided or two-tail teste, 52-67, ISO, 152, 156, 
425 

Two-sided toleraocs limits, 47n., 07— 69. 100-108 
U 

U'. normal deviate exceeded with probability p, 
72 

V : upper limit of acceptable ranges in samj^e of >1, 
237, 228 

Ui upper limit of a measured quality charaeteris- 
tic, above which an item ia defective, 9-12 
(See alto L) 
selection of, 46, 47 
as tolerance limit, 47 
l7-*haped diatnbutmn, li)4, 222 
United States Government, vii 

(See also Army; Bureau of the Census: De- 
partment of Agriculture; National Bureau 
of Standards; National Defense neaeareb 
Committee; Navy; Office of Scientific 
Research and Development) 

Universe (t«« Lot; Population) 

Univereity, Brown, Lv 

of Chicago, iii, ix-xii, 0, 348, 320, 340. 364. 418 
Columbia, iii, vii, ix-xii 

(5e< alto Statistical Research Oroup) 
of North Carolina, is, si, 112, 248 
Princeton, is 

Stanford, is, s, xi. 06, 384 
of Wisconsin, Is, 354 

Upper and lower limits (see Twn-eided enterion; 
Two-sided tests; Two-sided tolerance limits) 

V 

Variables, inspection by, 7-93, 113-184. 227-234, 
269-206, 377-382, 385-393, 423. 426 
advantages of, 7-0 

smount of inspection in (••« N ; ^ : Nw; St) 
(3es alto Amount of inspection) 
conditions for advantageous use of, 9 
curtailment of, 14, 15 
disadvantages of, 8, 9 
for fraction defective, 7-93 

acceptance enteria in, 12, 14, 17, 33-41, 52— 
56, 67-71, 85 

(See also Computation, of acceptance re- 
gion; Formula, for acceptance criterion; 
Graphical procedure) 
advantagee of. 7-9 

amount of inspection, 17, 21. 27, 28, 64-66, 
81. 82, 65 

(3«< alto Amount of iiiapeclion; S; 

Smi N.; NO 

condition for advantageous use of, 9 
contraaVed with attributes inspectvoft, 7-9, 
26-28 

criteria, use of pair of one-sided in. 53, 54 
figure showing, 55 

criterion, use of single two-eided, 52-57, 63, 64 


Variables, inspection by, for fraction defective, 
criterion for changing to reduced or tight- 
ened inspection in, 42 
formulas for (tee Formula) 
graphical procedure in (tee Graphical proce- 
dure) 

when inspection is costly, 9 
when lot mean (m) it known, 27n., 28fl., 
230-234, 270, 271, 274, 27.5, 278-280 
when lot standard deviation (s) is known, 
27, 28. 61, 62, 423 

operating characteristics of (see Operating 
characteHstica; Opersting-eharacf eristic 
curves; Operating-characteristic surface) 
pUn of actioa, 14, 16-21, 33-41. 

choice of, 45-49 
oequential, $3-85 
single sample, 7-82 

when upper and lower Umlts are imposed on 
a single quality characteristic, 52—57, 53, 64 
for fraction of ranges in samples of fe that 
exceed specified limit, 227-234 
formulation in terms of a, 229-231 
muUivariate, 113-184 

operating characteristics of (tee Operating 
characterietics; Operating-characteristic 
curves; Operating-cliaracteristio surface) 
for percent defective (tee Vsriablee, for fraelioa 
defective) 

eequentUi-eampling, 83-85, 232. 233, 423, 426 
eingle-sampling, 7-82, 113-184 , 231, 232, 269- 
296. 377-382, 385-303 

tise of several acceptance criteria in, 50-56. 63. 
64. 113. 114 

Variability, determining whether new method, 
process, or product eaceeds a standard in 
respect to. 227-234, 270, 271, 274, 275, 278- 
280 

determining whether a particular one of two 
methods, processes, or products exceeds 
the other in ree)>ecrt to, 280, 282, 283. 296 
measures of (see Mean deriation; Range; 
Standard deviation; Variance) 

Variance, analysis of, 297, 310-314, 385, 386 
(See also Analysis oi variance) 
oi binomial dietrihutioii, 397, 410 
components of, 269, 297, 310-314 

due to grouping or rounding, 195, 218 
of correlation coefficient (r). 413 
definition of, 161, 195 
estimates of, 13, 13, 43. 162, 198 (See also i*) 
x*-feat of. 231. 232, 270-280 
F-teets of, 2SG-296, 311-314 
homogeneity of, Bartlett’a test for, 183, 387, 
388 

largest of several, Cochran's test far eig- 
nificanee of, 383—394 

expetimenU pertaining to, derign and aDalysis 
of. 227-234, 269-318 
of groiu)>ed dialTtbuMon, 195 
of interpolated value, 219-221 
of lot (e*), as measure of lot quality (see Stand- 
ard deviation, of lot) 

(See also Variance, oi population) 
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Variance, of maximum likelihood esUinator of 
mean of normal population, when data are 
grouped or rounded, 197 
of mean, 162, 198 

when data are grouped or rounded, 197, 19S 
of mean deviation, in normal Bamplea, 162, 163, 
169 

of median, in normal samples, 162 
of normal distribution, 161, 198 

(Sea alto Standard deviation, of normal 
distribution) 

bias of e* as estimator of, when data are 
grouped or rounded, 198-200, 203-'2l4 
estimation of, from moan deviation, 162, 163, 
169 

from probit data, 312-352 
from range, 227 

/rom'«», 12, 13, 43, 162, 198-200. 203-214 
from sensitivity tests, 342-352 
as parameter of. 12, 161 

tests of significanoe relating to, sequential, 
232, 233. 426 

singte-astnnle. 231. 232. 269-296. 383-394 
of Poieson distribution, 411 
of population (v), bias of i* as estimator of, 
when data are grouped nr rnunded. 19^ 
200. 203-214 

confidence limits for, 198-2ftO. 213. 214 
eatimation of, from mean deviation, 162. 
163, 169 

from probit data, 342-352 
from range, 227 

from t*. 12, 13. 43, 102, 198-200, 203-214 
from sensitivity testa, 342-3S2 
importance of distinguishing from a*. 12 
teats of signidesaee relating to, sequential, 
232, 233, 426 

single^sample, 231, 232, 269-296, 383-394 
of proportion or percentage, 397, 410 
of r, 413 

oi' range vVee d’tano’arrfdVfviifi'jn, 0/ range/ 
ratio (lee F) 

of rectangular distribution, 195-218 
of a*, in samples from arbitrarj', grouped, and 
normal populations, 199 
from normal population, formula, 199, 412 
when data are grouped or rounded, 
formula, 109, 211 

Stabilizing, by transformation 0/ data, general 
procedure for, 408-410 
applications of, 410-413 

(See also Inverse-sine iransfoimation) 

W 

IV or Vr*; multiple of v in terms of which cumula- 
tive distribution of sample range in samples 
of k (Rt) is given, 229, 230 
10: width of grouping or rounding interval, 193 
(•ee Grouping interval! 

Wald, Abraham, ix, 62n., 83n., 99, 108n., 110, 
143fj., 147, 166n., 184, 419n., 429 


Wallis, W. Allen, Ui, x-xii, 6, 167n., 184, 248, 418, 
419n. 

Weaver. C. L., 318n. 

Weaver, Warren, v, vil, x 

Weights, use of, in fitting line by least squares, 
343, 344 

when dependent variable is expressed in probita, 
343, 344, 350 

Wdeh, B. L., 8n., 22, 40. 58n., 04, 72-74, 7f>, 77, 
79 r., 86, 93, 99, 381, 382 
quotation from paper by, with W. J. Jennett, 
49-50 

VVil6nslEi, II., 46 r., 93, 255n., 265 
Wdks. Samuel S., 99, 110, 166»., 173, 174, 184 
Wishart, John, 218, 219n.. 220n,, 221, 222 
Wold, Herman, 193 r., 196n., 223 
Wolfowitz, Jacob, x, xi, 52>t., lOSn., 110, 330 
Work sheets, tor acceptance-region boundary, 
using two-sided criterion, 57 
for k. 77-79 
for OC curve, 32. 80 

WPA tables (tee Mathematical Tables Project) 
Wright, SewaU, 208 

X 

z: a measurement of a variable quality cbarac- 
teristic, 12 

i: arithmetic mean of aainple measurements (tee 
Sample mean) 

* + kt. 12. 14. 33, 36, 47n., 50, 53, 50, 61, 62, 64, 
66, 71. 83 

(See otto Acceptance criterion, in variables 
inspection for fraciion defective; Toler- 
ance limits) 

bias of, as eetimator of w itv, in normal 
samples, 58 

expected or mean value of, in normal samples. 
58 

etandard deviation of. in normal aamples, 68 
2 - ke. 13. 47r.. 53 
X + Ks. 98, 09, 102 

(See aleo Tolerance factor; Tolerance limits) 
(: mean of a normal distribution, 164 

Y 

Yardsticks, for dilTerencea of means, 150 
for T-etatisties, 156 
for variance estimates, 256 
Yates, Frank. 18n., 93, I20n., 148n., 151n., 152n., 
183, 234, 255, 258n., 263, 315n., 317n.. 318. 
342«., 343»., 352, 398, 39yn., 405, 407, 415 
Yates’ correction of x* foJ continuity, 254. 257 

Z 

a: s normally distributed variable. 61, 73 
a-transformation, of correlation coefficient (r), 
413 

of variance ralio (F), 317n. 

Zubin, Joseph. 257, 258, 265, 398, 400 
Zubin-Fulcher Itern Analyzer, 257, 258, 405 , 415 



